2024-09-17T00:43:28.774 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T00:43:28.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T00:43:28.863 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978 branch: squid description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} email: ceph-qa@ceph.com first_in_suite: false job_id: '7907978' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - CEPHADM_STRAY_DAEMON - CEPHADM_FAILED_DAEMON - CEPHADM_AGENT_DOWN log-only-match: - CEPHADM_ sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f workunit: branch: squid sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 599 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 33/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAS8vbbspXGpl8Q5rGhX/Oa5aL7gBGaFaCuQvNi/7Wgc0MtijIw7yq27WS+k86fuKzW0h0G2aSXaG3xEXYKmY1Q= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHe+CfnjIfbcsf72b3JUYuyfHBzDA4O+V2Zyxgwt/nQPyMvg+GHJhNai4I1b1WZuaBoGYdiVio6wWaKQQKNj0jU= tasks: - cephadm: cephadm_branch: v17.2.0 cephadm_git_url: https://github.com/ceph/ceph image: quay.io/ceph/ceph:v17.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000 - ceph orch apply rgw smpl - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph orch upgrade status - ceph health detail - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_21:08:04 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T00:43:28.863 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa; will attempt to use it 2024-09-17T00:43:28.864 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks 2024-09-17T00:43:28.864 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T00:43:28.866 INFO:teuthology.task.internal:Checking packages... 2024-09-17T00:43:28.889 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-17T00:43:28.889 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:43:28.889 INFO:teuthology.packaging:ref: None 2024-09-17T00:43:28.889 INFO:teuthology.packaging:tag: None 2024-09-17T00:43:28.889 INFO:teuthology.packaging:branch: squid 2024-09-17T00:43:28.889 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:43:28.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T00:43:29.111 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-17T00:43:29.112 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T00:43:29.118 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T00:43:29.118 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T00:43:29.137 INFO:teuthology.task.internal:Saving configuration 2024-09-17T00:43:29.148 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T00:43:29.231 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T00:43:29.255 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 00:38:38.397958', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAS8vbbspXGpl8Q5rGhX/Oa5aL7gBGaFaCuQvNi/7Wgc0MtijIw7yq27WS+k86fuKzW0h0G2aSXaG3xEXYKmY1Q='} 2024-09-17T00:43:29.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 00:38:38.399842', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHe+CfnjIfbcsf72b3JUYuyfHBzDA4O+V2Zyxgwt/nQPyMvg+GHJhNai4I1b1WZuaBoGYdiVio6wWaKQQKNj0jU='} 2024-09-17T00:43:29.277 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T00:43:29.283 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-09-17T00:43:29.283 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-09-17T00:43:29.283 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T00:43:29.398 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9fdedd7ac0>, signals=[15]) 2024-09-17T00:43:29.398 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T00:43:29.404 INFO:teuthology.task.internal:Opening connections... 2024-09-17T00:43:29.404 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-17T00:43:29.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:43:29.482 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-17T00:43:29.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:43:29.557 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T00:43:29.563 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-17T00:43:29.581 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-17T00:43:29.582 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T00:43:29.639 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-17T00:43:29.640 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-17T00:43:29.640 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T00:43:29.640 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-17T00:43:29.640 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T00:43:29.640 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T00:43:29.640 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T00:43:29.640 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-17T00:43:29.665 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-17T00:43:29.683 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-17T00:43:29.684 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-09-17T00:43:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-09-17T00:43:29.743 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T00:43:29.743 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-09-17T00:43:29.743 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T00:43:29.743 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T00:43:29.743 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T00:43:29.743 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-17T00:43:29.765 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T00:43:29.773 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T00:43:29.866 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T00:43:29.867 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-17T00:43:29.869 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-17T00:43:29.886 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T00:43:29.965 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T00:43:29.966 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-17T00:43:29.968 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-17T00:43:30.243 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T00:43:30.301 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T00:43:30.314 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T00:43:30.315 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T00:43:30.315 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T00:43:30.315 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T00:43:30.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:43:30.333 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-17T00:43:30.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:43:30.334 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-17T00:43:30.391 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-503.el9.x86_64 2024-09-17T00:43:30.391 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-503.el9.x86_64 2024-09-17T00:43:30.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-09-17T00:43:30.393 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-503.el9.x86_64 2024-09-17T00:43:30.393 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-503.el9.x86_64 2024-09-17T00:43:30.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-09-17T00:43:33.025 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-17T00:43:34.685 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-17T00:43:35.051 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-17T00:43:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-17T00:43:39.438 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.5 MB 00:00 2024-09-17T00:43:40.946 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-17T00:43:42.169 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-17T00:43:43.544 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 120 kB/s | 19 kB 00:00 2024-09-17T00:43:44.292 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 23 MB 00:03 2024-09-17T00:43:45.408 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 13 MB/s | 23 MB 00:01 2024-09-17T00:43:49.731 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-17T00:43:50.804 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-17T00:43:51.679 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T00:43:51.679 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T00:43:51.776 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-17T00:43:51.782 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-17T00:43:51.782 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-09-17T00:43:51.783 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:43:51.784 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 79 M 2024-09-17T00:43:51.784 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 126 M 2024-09-17T00:43:51.784 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-17T00:43:51.985 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 457 kB/s | 36 kB 00:00 2024-09-17T00:43:52.736 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T00:43:52.736 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T00:43:52.841 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-17T00:43:52.853 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-17T00:43:52.853 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-17T00:43:52.854 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:43:52.855 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 79 M 2024-09-17T00:43:52.855 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 126 M 2024-09-17T00:43:52.855 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-17T00:43:53.414 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 118 kB/s | 36 kB 00:00 2024-09-17T00:43:54.856 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-09-17T00:43:55.573 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-09-17T00:43:56.068 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-17T00:43:56.106 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-17T00:43:56.107 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:43:56.107 INFO:teuthology.orchestra.run.smithi071.stdout:Total 24 MB/s | 79 MB 00:03 2024-09-17T00:43:56.791 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-17T00:43:57.138 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-17T00:43:57.139 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-17T00:43:58.115 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-17T00:43:58.115 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-17T00:43:59.476 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.8 MB/s | 29 MB 00:07 2024-09-17T00:44:00.527 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-17T00:44:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:44:01.218 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.7 MB/s | 35 MB 00:09 2024-09-17T00:44:01.218 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:44:01.218 INFO:teuthology.orchestra.run.smithi135.stdout:Total 8.4 MB/s | 79 MB 00:09 2024-09-17T00:44:01.258 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:44:01.904 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-17T00:44:02.280 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-17T00:44:02.281 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-17T00:44:03.245 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-17T00:44:03.245 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-17T00:44:04.036 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:44:04.171 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:44:05.702 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-17T00:44:06.397 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:44:06.484 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:44:09.002 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:44:09.163 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:09.284 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:44:09.411 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:44:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:14.265 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:44:14.394 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:19.249 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:52.020 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:52.059 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:52.421 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:52.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:44:52.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:44:52.421 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:44:53.271 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:53.271 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:44:53.271 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-17T00:44:53.271 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T00:44:53.272 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T00:44:53.272 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T00:44:53.272 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T00:44:53.272 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:44:53.272 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-17T00:44:53.590 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:44:53.681 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:44:53.682 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:44:53.682 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T00:44:53.682 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T00:44:53.682 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T00:44:53.682 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T00:44:53.683 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T00:44:53.683 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:44:53.741 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:44:53.742 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:44:53.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-09-17T00:44:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-09-17T00:44:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-09-17T00:44:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-09-17T00:44:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 82.el9 2024-09-17T00:44:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-09-17T00:44:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T00:44:53.785 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8274670 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:44:53.786 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T00:44:53.787 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T00:44:53.787 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T00:44:53.787 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-09-17T00:44:53.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:44:53.787 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T00:44:53.788 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T00:44:53.788 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 5.14.0-508.el9.x86_64 2024-09-17T00:44:53.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T00:44:54.465 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-09-17T00:44:55.767 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T00:44:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-09-17T00:44:55.806 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-17T00:44:55.821 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.C8x5ndHJiG 2024-09-17T00:44:55.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.C8x5ndHJiG 2024-09-17T00:44:55.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.C8x5ndHJiG 2024-09-17T00:44:56.023 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.C8x5ndHJiG is 6KB 2024-09-17T00:44:56.043 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.C8x5ndHJiG 2024-09-17T00:44:56.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T00:44:56.121 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T00:44:56.121 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T00:44:56.121 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T00:44:56.121 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T00:44:56.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T00:44:56.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-09-17T00:44:57.773 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:57.814 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:58.096 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:58.096 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:44:58.096 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:44:58.096 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:44:58.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:44:58.962 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:44:58.962 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-17T00:44:58.962 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T00:44:58.963 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T00:44:58.963 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T00:44:58.963 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T00:44:58.963 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:44:58.963 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-17T00:44:59.321 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:44:59.409 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:44:59.410 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:44:59.410 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T00:44:59.410 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T00:44:59.410 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T00:44:59.410 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T00:44:59.410 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T00:44:59.410 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:44:59.470 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:44:59.470 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:44:59.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-09-17T00:44:59.502 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-09-17T00:44:59.502 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 82.el9 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8274670 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-09-17T00:44:59.503 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:44:59.504 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T00:44:59.505 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T00:44:59.505 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-508.el9.x86_64 2024-09-17T00:44:59.505 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T00:45:00.283 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-09-17T00:45:01.669 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T00:45:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-09-17T00:45:01.714 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-17T00:45:01.730 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.oe3zuf9ibh 2024-09-17T00:45:01.730 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oe3zuf9ibh 2024-09-17T00:45:01.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.oe3zuf9ibh 2024-09-17T00:45:01.961 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.oe3zuf9ibh is 6KB 2024-09-17T00:45:02.011 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.oe3zuf9ibh 2024-09-17T00:45:02.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T00:45:02.097 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T00:45:02.097 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T00:45:02.098 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T00:45:02.098 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T00:45:02.099 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T00:45:02.252 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-09-17T00:45:26.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T00:45:26.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-17T00:45:26.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:45:32.261 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T00:45:32.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-17T00:45:32.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:45:44.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-17T00:45:50.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-17T00:45:53.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-17T00:45:53.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:45:59.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-17T00:45:59.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:46:02.849 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-17T00:46:14.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-17T00:46:14.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:46:46.717 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-17T00:46:47.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-17T00:46:47.074 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T00:46:47.074 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-17T00:46:47.089 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-508.el9.x86_64 2024-09-17T00:46:47.089 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T00:46:47.089 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T00:46:47.089 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T00:46:48.090 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T00:46:48.090 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T00:46:48.192 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-09-17T00:46:48.215 DEBUG:teuthology.parallel:result is None 2024-09-17T00:46:53.644 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T00:47:05.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-17T00:47:05.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:47:06.071 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-17T00:47:06.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-17T00:47:06.412 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T00:47:06.413 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-17T00:47:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-508.el9.x86_64 2024-09-17T00:47:06.428 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T00:47:06.429 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T00:47:06.429 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T00:47:07.430 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T00:47:07.430 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T00:47:07.790 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-09-17T00:47:07.818 DEBUG:teuthology.parallel:result is None 2024-09-17T00:47:07.819 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T00:47:07.827 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T00:47:07.828 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T00:47:07.830 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T00:47:07.850 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T00:47:07.941 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T00:47:08.018 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T00:47:08.018 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T00:47:08.021 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T00:47:08.060 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T00:47:08.119 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T00:47:08.119 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T00:47:08.122 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T00:47:08.153 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:47:08.162 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:47:08.163 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:47:08.173 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:47:08.175 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T00:47:08.201 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T00:47:08.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T00:47:08.218 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T00:47:08.245 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T00:47:08.263 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T00:47:08.263 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T00:47:08.286 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T00:47:08.303 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:47:08.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:47:08.433 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:47:08.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:47:08.560 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:47:08.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T00:47:08.628 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:47:08.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:47:08.739 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:47:08.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:47:08.824 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-17T00:47:08.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T00:47:08.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-17T00:47:08.893 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-17T00:47:08.954 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T00:47:08.976 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T00:47:09.432 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T00:47:09.440 INFO:teuthology.task.internal:Starting timer... 2024-09-17T00:47:09.440 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T00:47:09.493 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T00:47:09.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-17T00:47:09.628 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-17T00:47:09.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-09-17T00:47:09.715 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-09-17T00:47:09.717 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T00:47:09.717 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-17T00:47:09.740 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-17T00:47:09.740 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-09-17T00:47:09.769 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-09-17T00:47:09.770 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-09-17T00:47:09.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T00:47:09.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:47:09.809 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T00:47:09.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:47:09.838 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T00:47:09.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-17T00:47:09.894 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-09-17T00:47:09.981 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T00:47:09.992 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T00:47:10.004 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T00:47:10.005 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T00:51:01.120 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-09-17T00:51:01.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-17T00:51:01.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:51:01.207 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-17T00:51:01.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-17T00:51:01.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-17T00:51:01.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:51:01.381 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-17T00:51:01.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-17T00:51:01.412 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T00:51:01.422 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T00:51:01.422 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T00:51:01.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T00:51:01.426 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T00:51:01.426 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T00:51:01.453 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T00:51:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T00:51:01.481 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T00:51:01.493 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-17T00:51:01.496 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T00:51:01.504 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-17T00:51:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T00:51:01.520 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-09-17T00:51:01.531 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-09-17T00:51:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T00:51:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T00:51:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T00:51:01.587 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-17T00:51:01.590 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T00:51:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-17T00:51:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.615 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-17T00:51:01.618 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T00:51:01.618 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-17T00:51:01.619 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.619 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.619 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.619 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:51:01.619 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T00:51:01.735 INFO:tasks.cephadm:Config: {'cephadm_branch': 'v17.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'quay.io/ceph/ceph:v17.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'CEPHADM_STRAY_DAEMON', 'CEPHADM_FAILED_DAEMON', 'CEPHADM_AGENT_DOWN'], 'log-only-match': ['CEPHADM_'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T00:51:01.735 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v17.2.0 2024-09-17T00:51:01.736 INFO:tasks.cephadm:Cluster fsid is e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:01.736 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T00:51:01.736 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.71', 'mon.c': '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]', 'mon.b': '172.21.15.135'} 2024-09-17T00:51:01.736 INFO:tasks.cephadm:First mon is mon.a on smithi071 2024-09-17T00:51:01.736 INFO:tasks.cephadm:First mgr is y 2024-09-17T00:51:01.737 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T00:51:01.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-09-17T00:51:01.763 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-09-17T00:51:01.789 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v17.2.0)... 2024-09-17T00:51:01.790 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:02.032 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Sep 17 00:51 /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:02.032 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:02.154 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Sep 17 00:51 /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:02.155 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:02.171 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:02.197 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v17.2.0 on all hosts... 2024-09-17T00:51:02.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-09-17T00:51:02.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-09-17T00:51:03.866 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-09-17T00:51:03.967 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-09-17T00:51:16.140 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T00:51:16.140 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-09-17T00:51:16.140 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-09-17T00:51:16.140 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-09-17T00:51:16.140 INFO:teuthology.orchestra.run.smithi071.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-09-17T00:51:16.140 INFO:teuthology.orchestra.run.smithi071.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-09-17T00:51:16.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-17T00:51:16.141 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T00:51:28.594 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-17T00:51:28.595 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-09-17T00:51:28.595 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-09-17T00:51:28.595 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-09-17T00:51:28.595 INFO:teuthology.orchestra.run.smithi135.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-09-17T00:51:28.596 INFO:teuthology.orchestra.run.smithi135.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-09-17T00:51:28.596 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-17T00:51:28.596 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-17T00:51:28.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-09-17T00:51:28.653 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-09-17T00:51:28.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-09-17T00:51:28.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-09-17T00:51:28.750 INFO:tasks.cephadm:Writing seed config... 2024-09-17T00:51:28.752 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-09-17T00:51:28.752 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T00:51:28.753 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T00:51:28.753 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-09-17T00:51:28.753 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T00:51:28.753 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T00:51:28.753 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T00:51:28.753 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T00:51:28.753 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T00:51:28.754 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:51:28.754 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T00:51:28.778 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e9235fcc-748e-11ef-bceb-c7b262605968 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-17T00:51:28.778 DEBUG:teuthology.orchestra.run.smithi071:mon.a> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service 2024-09-17T00:51:28.821 DEBUG:teuthology.orchestra.run.smithi071:mgr.y> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service 2024-09-17T00:51:28.864 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T00:51:28.864 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 -v bootstrap --fsid e9235fcc-748e-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.71 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:51:29.055 INFO:teuthology.orchestra.run.smithi071.stderr:-------------------------------------------------------------------------------- 2024-09-17T00:51:29.055 INFO:teuthology.orchestra.run.smithi071.stderr:cephadm ['--image', 'quay.io/ceph/ceph:v17.2.0', '-v', 'bootstrap', '--fsid', 'e9235fcc-748e-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.71', '--skip-admin-label'] 2024-09-17T00:51:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: 5.2.2 2024-09-17T00:51:29.080 INFO:teuthology.orchestra.run.smithi071.stderr:Verifying podman|docker is present... 2024-09-17T00:51:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: 5.2.2 2024-09-17T00:51:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:Verifying lvm2 is present... 2024-09-17T00:51:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:Verifying time synchronization is in place... 2024-09-17T00:51:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T00:51:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: inactive 2024-09-17T00:51:29.123 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: enabled 2024-09-17T00:51:29.129 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: active 2024-09-17T00:51:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:Unit chronyd.service is enabled and running 2024-09-17T00:51:29.130 INFO:teuthology.orchestra.run.smithi071.stderr:Repeating the final host check... 2024-09-17T00:51:29.150 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: 5.2.2 2024-09-17T00:51:29.152 INFO:teuthology.orchestra.run.smithi071.stderr:podman (/bin/podman) version 5.2.2 is present 2024-09-17T00:51:29.153 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl is present 2024-09-17T00:51:29.153 INFO:teuthology.orchestra.run.smithi071.stderr:lvcreate is present 2024-09-17T00:51:29.158 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T00:51:29.164 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: inactive 2024-09-17T00:51:29.171 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: enabled 2024-09-17T00:51:29.177 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: active 2024-09-17T00:51:29.178 INFO:teuthology.orchestra.run.smithi071.stderr:Unit chronyd.service is enabled and running 2024-09-17T00:51:29.178 INFO:teuthology.orchestra.run.smithi071.stderr:Host looks OK 2024-09-17T00:51:29.179 INFO:teuthology.orchestra.run.smithi071.stderr:Cluster fsid: e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:29.179 INFO:teuthology.orchestra.run.smithi071.stderr:Acquiring lock 140680160727680 on /run/cephadm/e9235fcc-748e-11ef-bceb-c7b262605968.lock 2024-09-17T00:51:29.179 INFO:teuthology.orchestra.run.smithi071.stderr:Lock 140680160727680 acquired on /run/cephadm/e9235fcc-748e-11ef-bceb-c7b262605968.lock 2024-09-17T00:51:29.179 INFO:teuthology.orchestra.run.smithi071.stderr:Verifying IP 172.21.15.71 port 3300 ... 2024-09-17T00:51:29.179 INFO:teuthology.orchestra.run.smithi071.stderr:Verifying IP 172.21.15.71 port 6789 ... 2024-09-17T00:51:29.179 INFO:teuthology.orchestra.run.smithi071.stderr:Base mon IP is 172.21.15.71, final addrv is [v2:172.21.15.71:3300,v1:172.21.15.71:6789] 2024-09-17T00:51:29.181 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.71 metric 100 2024-09-17T00:51:29.181 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.71 metric 100 2024-09-17T00:51:29.184 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T00:51:29.184 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-17T00:51:29.184 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-17T00:51:29.187 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T00:51:29.187 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-09-17T00:51:29.187 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-09-17T00:51:29.187 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-17T00:51:29.187 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link noprefixroute 2024-09-17T00:51:29.187 INFO:teuthology.orchestra.run.smithi071.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-09-17T00:51:29.187 INFO:teuthology.orchestra.run.smithi071.stderr:Mon IP `172.21.15.71` is in CIDR network `172.21.0.0/20` 2024-09-17T00:51:29.188 INFO:teuthology.orchestra.run.smithi071.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T00:51:29.188 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-09-17T00:51:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Trying to pull quay.io/ceph/ceph:v17.2.0... 2024-09-17T00:51:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Getting image source signatures 2024-09-17T00:51:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Copying blob sha256:33ca8fff7868c4dc0c11e09bca97c720eb9cfbab7221216754367dd8de70388a 2024-09-17T00:51:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Copying blob sha256:89b4a75bc2d8500f15463747507c9623df43886c134463e7f0527e70900e7a7b 2024-09-17T00:51:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Copying blob sha256:c32ab78b488d0c72f64eded765c0cf6b5bf2c75dab66cb62a9d367fa6ec42513 2024-09-17T00:51:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Copying blob sha256:a70843738bb77e1ab9c1f85969ebdfa55f178e746be081d1cb4f94011f69eb7c 2024-09-17T00:51:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Copying blob sha256:599d07cb321ff0a3c82224e1138fc685793fa69b93ed5780415751a5f7e4b8c2 2024-09-17T00:51:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Copying config sha256:e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-09-17T00:51:31.687 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: Writing manifest to image destination 2024-09-17T00:51:33.094 INFO:teuthology.orchestra.run.smithi071.stderr:/bin/podman: e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-09-17T00:51:35.094 INFO:teuthology.orchestra.run.smithi071.stderr:ceph: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-09-17T00:51:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:Ceph version: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-09-17T00:51:35.638 INFO:teuthology.orchestra.run.smithi071.stderr:Extracting ceph user uid/gid from container image... 2024-09-17T00:51:36.036 INFO:teuthology.orchestra.run.smithi071.stderr:stat: 167 167 2024-09-17T00:51:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:Creating initial keys... 2024-09-17T00:51:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph-authtool: AQCY0uhmIFO5ORAAmmYMFsTb2O2I6Tze8ljjdg== 2024-09-17T00:51:37.946 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph-authtool: AQCZ0uhmL8+RMxAAZBHnLmd6yL8QB/oADcC/1g== 2024-09-17T00:51:38.928 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph-authtool: AQCa0uhmB5XoMRAAE0pLqzEq34YI9b5+GquWWA== 2024-09-17T00:51:39.425 INFO:teuthology.orchestra.run.smithi071.stderr:Creating initial monmap... 2024-09-17T00:51:39.832 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T00:51:39.832 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2024-09-17T00:51:39.832 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:39.832 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T00:51:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:monmaptool for a [v2:172.21.15.71:3300,v1:172.21.15.71:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T00:51:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:setting min_mon_release = octopus 2024-09-17T00:51:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/monmaptool: set fsid to e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T00:51:41.089 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:51:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:Creating mon... 2024-09-17T00:51:42.094 INFO:teuthology.orchestra.run.smithi071.stderr:create mon.a on 2024-09-17T00:51:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T00:51:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e9235fcc-748e-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-e9235fcc-748e-11ef-bceb-c7b262605968.target. 2024-09-17T00:51:42.477 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-e9235fcc-748e-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-e9235fcc-748e-11ef-bceb-c7b262605968.target. 2024-09-17T00:51:42.781 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Failed to reset failed state of unit ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-17T00:51:42.788 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Created symlink /etc/systemd/system/ceph-e9235fcc-748e-11ef-bceb-c7b262605968.target.wants/ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-e9235fcc-748e-11ef-bceb-c7b262605968@.service. 2024-09-17T00:51:43.434 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:43 smithi071 podman[23412]: 2024-09-17 00:51:43.394427961 +0000 UTC m=+0.338747208 container start 80c056377075cac1f54ad9d06182497eb75955284fe0a28312dce92862418419 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, version=8, name=centos-stream, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, io.buildah.version=1.19.8, architecture=x86_64, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, maintainer=Guillaume Abrioux ) 2024-09-17T00:51:43.434 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:43 smithi071 ceph-mon[23431]: mkfs e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:43.458 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: disabled 2024-09-17T00:51:43.465 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: inactive 2024-09-17T00:51:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:firewalld.service is not enabled 2024-09-17T00:51:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:Not possible to enable service . firewalld.service is not available 2024-09-17T00:51:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for mon to start... 2024-09-17T00:51:43.466 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for mon... 2024-09-17T00:51:43.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:43 smithi071 ceph-mon[23431]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T00:51:43.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:43 smithi071 bash[23412]: 80c056377075cac1f54ad9d06182497eb75955284fe0a28312dce92862418419 2024-09-17T00:51:43.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:43 smithi071 systemd[1]: Started Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: cluster: 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: id: e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: services: 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.550249s) 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mgr: no daemons active 2024-09-17T00:51:43.980 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-09-17T00:51:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: data: 2024-09-17T00:51:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-09-17T00:51:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-09-17T00:51:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-09-17T00:51:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: pgs: 2024-09-17T00:51:43.981 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:mon is available 2024-09-17T00:51:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:Assimilating anything we can from ceph.conf... 2024-09-17T00:51:44.634 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:44 smithi071 ceph-mon[23431]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T00:51:44.635 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:44 smithi071 ceph-mon[23431]: monmap e1: 1 mons at {a=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0]} 2024-09-17T00:51:44.635 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:44 smithi071 ceph-mon[23431]: fsmap 2024-09-17T00:51:44.635 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:44 smithi071 ceph-mon[23431]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T00:51:44.635 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:44 smithi071 ceph-mon[23431]: mgrmap e1: no daemons active 2024-09-17T00:51:44.635 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:44 smithi071 ceph-mon[23431]: from='client.? 172.21.15.71:0/4262603986' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: [global] 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: fsid = e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.71:3300,v1:172.21.15.71:6789] 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-09-17T00:51:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: [mgr] 2024-09-17T00:51:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mgr/cephadm/use_agent = True 2024-09-17T00:51:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-09-17T00:51:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: [osd] 2024-09-17T00:51:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-09-17T00:51:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-09-17T00:51:45.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:45 smithi071 ceph-mon[23431]: from='client.? 172.21.15.71:0/2653751682' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T00:51:45.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:45 smithi071 ceph-mon[23431]: from='client.? 172.21.15.71:0/2653751682' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T00:51:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:Generating new minimal ceph.conf... 2024-09-17T00:51:46.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:46 smithi071 ceph-mon[23431]: from='client.? 172.21.15.71:0/3539289519' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:51:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:Restarting the monitor... 2024-09-17T00:51:47.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:46 smithi071 systemd[1]: Stopping Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:51:47.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:46 smithi071 bash[23651]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon.a" found: no such container 2024-09-17T00:51:47.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[23427]: 2024-09-17T00:51:47.062+0000 7fcb7d91c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T00:51:47.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[23427]: 2024-09-17T00:51:47.062+0000 7fcb7d91c700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T00:51:47.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 podman[23663]: 2024-09-17 00:51:47.20583869 +0000 UTC m=+0.254080945 container died 80c056377075cac1f54ad9d06182497eb75955284fe0a28312dce92862418419 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, GIT_CLEAN=True, vendor=Red Hat, Inc., version=8, RELEASE=HEAD, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, io.openshift.tags=base centos centos-stream, ceph=True) 2024-09-17T00:51:47.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 podman[23663]: 2024-09-17 00:51:47.570587679 +0000 UTC m=+0.618829932 container cleanup 80c056377075cac1f54ad9d06182497eb75955284fe0a28312dce92862418419 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, ceph=True, release=754, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, com.redhat.component=centos-stream-container) 2024-09-17T00:51:47.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 bash[23663]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a 2024-09-17T00:51:47.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 bash[23690]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon.a" found: no such container 2024-09-17T00:51:48.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 podman[23675]: 2024-09-17 00:51:47.821461184 +0000 UTC m=+0.610904451 container remove 80c056377075cac1f54ad9d06182497eb75955284fe0a28312dce92862418419 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, io.buildah.version=1.19.8, distribution-scope=public, version=8, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , RELEASE=HEAD, ceph=True, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-09-17T00:51:48.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T00:51:48.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 systemd[1]: Stopped Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:51:48.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:47 smithi071 systemd[1]: Starting Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:51:48.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 podman[23751]: 2024-09-17 00:51:47.954388806 +0000 UTC m=+0.016248592 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-09-17T00:51:48.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 podman[23751]: 2024-09-17 00:51:48.055563463 +0000 UTC m=+0.117423282 container create f9d5e1454b7798f07c7a28e203681b60aa8b81fee8349e811a7a5fb3fce10965 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, vendor=Red Hat, Inc., release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, RELEASE=HEAD, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , io.openshift.expose-services=, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., CEPH_POINT_RELEASE=-17.2.0) 2024-09-17T00:51:48.341 INFO:teuthology.orchestra.run.smithi071.stderr:Setting mon public_network to 172.21.0.0/20 2024-09-17T00:51:48.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 podman[23751]: 2024-09-17 00:51:48.257995243 +0000 UTC m=+0.319855026 container init f9d5e1454b7798f07c7a28e203681b60aa8b81fee8349e811a7a5fb3fce10965 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, maintainer=Guillaume Abrioux , io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, ceph=True, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True) 2024-09-17T00:51:48.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 podman[23751]: 2024-09-17 00:51:48.261309425 +0000 UTC m=+0.323169202 container start f9d5e1454b7798f07c7a28e203681b60aa8b81fee8349e811a7a5fb3fce10965 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, architecture=x86_64, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, name=centos-stream, RELEASE=HEAD, io.openshift.expose-services=, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-09-17T00:51:48.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T00:51:48.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-09-17T00:51:48.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: pidfile_write: ignore empty --pid-file 2024-09-17T00:51:48.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: load: jerasure load: lrc 2024-09-17T00:51:48.465 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: RocksDB version: 6.15.5 2024-09-17T00:51:48.466 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-17T00:51:48.466 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Compile date Apr 18 2022 2024-09-17T00:51:48.466 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: DB SUMMARY 2024-09-17T00:51:48.466 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: DB Session ID: 5CIML9ZAAYXL7LOQQ36Z 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: CURRENT file: CURRENT 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 82637 ; 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.error_if_exists: 0 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.create_if_missing: 0 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.paranoid_checks: 1 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.env: 0x564807ac6860 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.fs: Posix File System 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.info_log: 0x564808aa5dc0 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T00:51:48.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.statistics: (nil) 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.use_fsync: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_log_file_size: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.allow_fallocate: 1 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.use_direct_reads: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.db_log_dir: 2024-09-17T00:51:48.468 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.write_buffer_manager: 0x564808b962a0 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T00:51:48.469 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.unordered_write: 0 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T00:51:48.470 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.row_cache: None 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.wal_filter: None 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.preserve_deletes: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.two_write_queues: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.atomic_flush: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.log_readahead_size: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T00:51:48.471 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_background_jobs: 2 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_background_compactions: -1 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_subcompactions: 1 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T00:51:48.472 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_open_files: -1 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_background_flushes: -1 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Compression algorithms supported: 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kZSTD supported: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kXpressCompression supported: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kLZ4Compression supported: 1 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kBZip2Compression supported: 0 2024-09-17T00:51:48.473 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kZlibCompression supported: 1 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: kSnappyCompression supported: 1 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.merge_operator: 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_filter: None 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564808a71d00) 2024-09-17T00:51:48.474 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_type: 0 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_index_type: 0 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_shortening: 1 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: hash_index_allow_collision: 1 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: checksum: 1 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: no_block_cache: 0 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache: 0x564808adc170 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_options: 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: capacity : 536870912 2024-09-17T00:51:48.475 INFO:journalctl@ceph.mon.a.smithi071.stdout: num_shard_bits : 4 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: strict_capacity_limit : 0 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_compressed: (nil) 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: persistent_cache: (nil) 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size: 4096 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size_deviation: 10 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_restart_interval: 16 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_block_restart_interval: 1 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: metadata_block_size: 4096 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: partition_filters: 0 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: use_delta_encoding: 1 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: whole_key_filtering: 1 2024-09-17T00:51:48.476 INFO:journalctl@ceph.mon.a.smithi071.stdout: verify_compression: 0 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout: format_version: 4 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_index_compression: 1 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_align: 0 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression: NoCompression 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.num_levels: 7 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T00:51:48.477 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T00:51:48.478 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T00:51:48.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T00:51:48.480 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.arena_block_size: 4194304 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T00:51:48.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.table_properties_collectors: 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.inplace_update_support: 0 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.bloom_locality: 0 2024-09-17T00:51:48.482 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.max_successive_merges: 0 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.ttl: 2592000 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.enable_blob_files: false 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.min_blob_size: 0 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T00:51:48.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534308287551, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534308288237, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79187, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77450, "index_size": 225, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10027, "raw_average_key_size": 47, "raw_value_size": 71759, "raw_average_value_size": 340, "num_data_blocks": 10, "num_entries": 211, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726534308, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "8e177241-048c-447e-a45b-206cd8fa56bc", "db_session_id": "5CIML9ZAAYXL7LOQQ36Z"}} 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534308288583, "job": 1, "event": "recovery_finished"} 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x564808ac2a80 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: DB pointer 0x564808ad2000 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** DB Stats ** 2024-09-17T00:51:48.484 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: L0 2/0 79.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Sum 2/0 79.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:51:48.485 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T00:51:48.486 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative compaction: 0.00 GB write, 25.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval compaction: 0.00 GB write, 25.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: L0 2/0 79.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: Sum 2/0 79.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T00:51:48.487 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative compaction: 0.00 GB write, 24.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T00:51:48.488 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: starting mon.a rank 0 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???) e1 preinit fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???).mds e1 new map 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???).mds e1 print_map 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout: e1 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout: legacy client fscid: -1 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout: No filesystems configured 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:51:48.489 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expand map: {default=false} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta from 'false' to 'false' 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expanded map: {default=false} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expand map: {default=info} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta from 'info' to 'info' 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expanded map: {default=info} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expand map: {default=daemon} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expanded map: {default=daemon} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expand map: {default=debug} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta from 'debug' to 'debug' 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: expand_channel_meta expanded map: {default=debug} 2024-09-17T00:51:48.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 bash[23751]: f9d5e1454b7798f07c7a28e203681b60aa8b81fee8349e811a7a5fb3fce10965 2024-09-17T00:51:48.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 systemd[1]: Started Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:51:48.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T00:51:48.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: monmap e1: 1 mons at {a=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0]} 2024-09-17T00:51:48.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: fsmap 2024-09-17T00:51:48.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T00:51:48.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:48 smithi071 ceph-mon[23769]: mgrmap e1: no daemons active 2024-09-17T00:51:49.430 INFO:teuthology.orchestra.run.smithi071.stderr:Wrote config to /etc/ceph/ceph.conf 2024-09-17T00:51:49.430 INFO:teuthology.orchestra.run.smithi071.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:51:49.430 INFO:teuthology.orchestra.run.smithi071.stderr:Creating mgr... 2024-09-17T00:51:49.431 INFO:teuthology.orchestra.run.smithi071.stderr:Verifying port 9283 ... 2024-09-17T00:51:49.606 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Failed to reset failed state of unit ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Unit ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service not loaded. 2024-09-17T00:51:49.613 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: Created symlink /etc/systemd/system/ceph-e9235fcc-748e-11ef-bceb-c7b262605968.target.wants/ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service → /etc/systemd/system/ceph-e9235fcc-748e-11ef-bceb-c7b262605968@.service. 2024-09-17T00:51:50.113 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:49 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/830437259' entity='client.admin' 2024-09-17T00:51:50.320 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: disabled 2024-09-17T00:51:50.328 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: inactive 2024-09-17T00:51:50.329 INFO:teuthology.orchestra.run.smithi071.stderr:firewalld.service is not enabled 2024-09-17T00:51:50.329 INFO:teuthology.orchestra.run.smithi071.stderr:Not possible to enable service . firewalld.service is not available 2024-09-17T00:51:50.338 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: disabled 2024-09-17T00:51:50.346 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: inactive 2024-09-17T00:51:50.347 INFO:teuthology.orchestra.run.smithi071.stderr:firewalld.service is not enabled 2024-09-17T00:51:50.347 INFO:teuthology.orchestra.run.smithi071.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-09-17T00:51:50.347 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for mgr to start... 2024-09-17T00:51:50.348 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for mgr... 2024-09-17T00:51:50.473 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:50.457+0000 7f6e1409a000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T00:51:50.726 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:50.636+0000 7f6e1409a000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T00:51:50.726 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:50.724+0000 7f6e1409a000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsid": "e9235fcc-748e-11ef-bceb-c7b262605968", 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "health": { 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "checks": {}, 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mutes": [] 2024-09-17T00:51:50.908 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum": [ 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 0 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_names": [ 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "a" 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "monmap": { 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-09-17T00:51:50.909 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_mons": 1 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osdmap": { 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_osds": 0, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgmap": { 2024-09-17T00:51:50.910 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pools": 0, 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_objects": 0, 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_total": 0 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsmap": { 2024-09-17T00:51:50.911 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "by_rank": [], 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "up:standby": 0 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mgrmap": { 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "available": false, 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modules": [ 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "iostat", 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "nfs", 2024-09-17T00:51:50.912 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "restful" 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "servicemap": { 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modified": "2024-09-17T00:51:43.433024+0000", 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "progress_events": {} 2024-09-17T00:51:50.913 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:51:51.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:50 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3596767400' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:51:51.073 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:50.862+0000 7f6e1409a000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:51:51.074 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:51.075+0000 7f6e1409a000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T00:51:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:mgr not available, waiting (1/15)... 2024-09-17T00:51:51.647 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:51.409+0000 7f6e1409a000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T00:51:51.647 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:51.497+0000 7f6e1409a000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T00:51:52.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:51.661+0000 7f6e1409a000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T00:51:53.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:52.696+0000 7f6e1409a000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T00:51:53.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:52.784+0000 7f6e1409a000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T00:51:53.872 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:53.691+0000 7f6e1409a000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T00:51:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:51:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsid": "e9235fcc-748e-11ef-bceb-c7b262605968", 2024-09-17T00:51:54.016 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "health": { 2024-09-17T00:51:54.017 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-09-17T00:51:54.017 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "checks": {}, 2024-09-17T00:51:54.017 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mutes": [] 2024-09-17T00:51:54.017 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:54.017 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-09-17T00:51:54.017 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum": [ 2024-09-17T00:51:54.018 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 0 2024-09-17T00:51:54.018 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:54.018 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_names": [ 2024-09-17T00:51:54.018 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "a" 2024-09-17T00:51:54.018 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:54.018 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_age": 5, 2024-09-17T00:51:54.018 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "monmap": { 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_mons": 1 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osdmap": { 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_osds": 0, 2024-09-17T00:51:54.019 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgmap": { 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-09-17T00:51:54.020 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-09-17T00:51:54.021 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pools": 0, 2024-09-17T00:51:54.021 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_objects": 0, 2024-09-17T00:51:54.021 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-09-17T00:51:54.021 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-09-17T00:51:54.021 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-09-17T00:51:54.021 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_total": 0 2024-09-17T00:51:54.022 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:54.022 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsmap": { 2024-09-17T00:51:54.022 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:54.022 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "by_rank": [], 2024-09-17T00:51:54.022 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "up:standby": 0 2024-09-17T00:51:54.022 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:54.023 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mgrmap": { 2024-09-17T00:51:54.023 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "available": false, 2024-09-17T00:51:54.023 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-09-17T00:51:54.023 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modules": [ 2024-09-17T00:51:54.023 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "iostat", 2024-09-17T00:51:54.023 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "nfs", 2024-09-17T00:51:54.023 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "restful" 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "servicemap": { 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modified": "2024-09-17T00:51:43.433024+0000", 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "progress_events": {} 2024-09-17T00:51:54.024 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:51:54.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.033+0000 7f6e1409a000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T00:51:54.443 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/615123471' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:51:54.443 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.171+0000 7f6e1409a000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:51:54.443 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.258+0000 7f6e1409a000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T00:51:54.443 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.357+0000 7f6e1409a000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T00:51:54.443 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.445+0000 7f6e1409a000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T00:51:54.612 INFO:teuthology.orchestra.run.smithi071.stderr:mgr not available, waiting (2/15)... 2024-09-17T00:51:54.778 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.592+0000 7f6e1409a000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T00:51:54.778 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.686+0000 7f6e1409a000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T00:51:54.778 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:54.780+0000 7f6e1409a000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T00:51:55.395 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:55.061+0000 7f6e1409a000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T00:51:55.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:55.148+0000 7f6e1409a000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T00:51:55.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:55.235+0000 7f6e1409a000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T00:51:56.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:51:56.286+0000 7f6e1409a000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: Activating manager daemon y 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: mgrmap e2: y(active, starting, since 0.00287288s) 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: Manager daemon y is now available 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:51:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' 2024-09-17T00:51:56.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' 2024-09-17T00:51:56.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:56 smithi071 ceph-mon[23769]: from='mgr.14100 172.21.15.71:0/1353743866' entity='mgr.y' 2024-09-17T00:51:57.091 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:51:57.091 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:51:57.091 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsid": "e9235fcc-748e-11ef-bceb-c7b262605968", 2024-09-17T00:51:57.091 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "health": { 2024-09-17T00:51:57.091 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "checks": {}, 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mutes": [] 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum": [ 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 0 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_names": [ 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "a" 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_age": 8, 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "monmap": { 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_mons": 1 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osdmap": { 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_osds": 0, 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-09-17T00:51:57.093 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-09-17T00:51:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-09-17T00:51:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-09-17T00:51:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgmap": { 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pools": 0, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_objects": 0, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_total": 0 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsmap": { 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "by_rank": [], 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "up:standby": 0 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mgrmap": { 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "available": false, 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modules": [ 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "iostat", 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "nfs", 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "restful" 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "servicemap": { 2024-09-17T00:51:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:51:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modified": "2024-09-17T00:51:43.433024+0000", 2024-09-17T00:51:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:51:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:51:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "progress_events": {} 2024-09-17T00:51:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:51:57.598 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:57 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3758106102' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:51:57.598 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:57 smithi071 ceph-mon[23769]: mgrmap e3: y(active, since 1.00568s) 2024-09-17T00:51:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:mgr not available, waiting (3/15)... 2024-09-17T00:51:59.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:51:59 smithi071 ceph-mon[23769]: mgrmap e4: y(active, since 2s) 2024-09-17T00:52:00.272 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:52:00.272 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:52:00.273 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsid": "e9235fcc-748e-11ef-bceb-c7b262605968", 2024-09-17T00:52:00.273 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "health": { 2024-09-17T00:52:00.273 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-09-17T00:52:00.273 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "checks": {}, 2024-09-17T00:52:00.273 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mutes": [] 2024-09-17T00:52:00.273 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:52:00.273 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum": [ 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 0 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_names": [ 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "a" 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "quorum_age": 11, 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "monmap": { 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_mons": 1 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:52:00.274 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osdmap": { 2024-09-17T00:52:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:52:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_osds": 0, 2024-09-17T00:52:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-09-17T00:52:00.275 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgmap": { 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_pools": 0, 2024-09-17T00:52:00.279 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_objects": 0, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "bytes_total": 0 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "fsmap": { 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "by_rank": [], 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "up:standby": 0 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mgrmap": { 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "available": true, 2024-09-17T00:52:00.280 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modules": [ 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "iostat", 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "nfs", 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "restful" 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ], 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "servicemap": { 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 1, 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "modified": "2024-09-17T00:51:43.433024+0000", 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "services": {} 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: }, 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "progress_events": {} 2024-09-17T00:52:00.281 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:52:00.570 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:00 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2512185304' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:52:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:mgr is available 2024-09-17T00:52:01.441 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:52:01.441 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: [global] 2024-09-17T00:52:01.441 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: fsid = e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: [mgr] 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: [osd] 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-09-17T00:52:01.442 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-09-17T00:52:01.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:01 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3159534722' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T00:52:01.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:01 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3159534722' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T00:52:02.021 INFO:teuthology.orchestra.run.smithi071.stderr:Enabling cephadm module... 2024-09-17T00:52:03.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:02 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3260595894' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T00:52:03.067 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setuser ceph since I am not root 2024-09-17T00:52:03.067 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setgroup ceph since I am not root 2024-09-17T00:52:03.067 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:02.907+0000 7fdd13521000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T00:52:03.067 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:02.985+0000 7fdd13521000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T00:52:03.375 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:03.158+0000 7fdd13521000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T00:52:03.375 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:03.246+0000 7fdd13521000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T00:52:03.625 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:03.378+0000 7fdd13521000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:52:03.625 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:03.594+0000 7fdd13521000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T00:52:03.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:03 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3260595894' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T00:52:03.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:03 smithi071 ceph-mon[23769]: mgrmap e5: y(active, since 6s) 2024-09-17T00:52:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:52:04.045 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 5, 2024-09-17T00:52:04.046 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "available": true, 2024-09-17T00:52:04.046 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "active_name": "y", 2024-09-17T00:52:04.046 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_standby": 0 2024-09-17T00:52:04.046 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:52:04.193 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:03.934+0000 7fdd13521000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T00:52:04.193 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:04.022+0000 7fdd13521000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T00:52:04.194 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:04.195+0000 7fdd13521000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T00:52:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for the mgr to restart... 2024-09-17T00:52:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for mgr epoch 5... 2024-09-17T00:52:04.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:04 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2673231549' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T00:52:05.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:05 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:05.251+0000 7fdd13521000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T00:52:05.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:05 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:05.342+0000 7fdd13521000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T00:52:06.517 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:06 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:06.219+0000 7fdd13521000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T00:52:06.830 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:06 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:06.520+0000 7fdd13521000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T00:52:06.830 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:06 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:06.650+0000 7fdd13521000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:52:06.830 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:06 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:06.736+0000 7fdd13521000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T00:52:06.831 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:06 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:06.832+0000 7fdd13521000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T00:52:07.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:06 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:06.918+0000 7fdd13521000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T00:52:07.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:07.062+0000 7fdd13521000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T00:52:07.521 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:07.153+0000 7fdd13521000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T00:52:07.521 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:07.247+0000 7fdd13521000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T00:52:07.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:07.524+0000 7fdd13521000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T00:52:07.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:07.610+0000 7fdd13521000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T00:52:07.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:07.697+0000 7fdd13521000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T00:52:09.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:08 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:08.740+0000 7fdd13521000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T00:52:09.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:09 smithi071 ceph-mon[23769]: Active manager daemon y restarted 2024-09-17T00:52:09.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:09 smithi071 ceph-mon[23769]: Activating manager daemon y 2024-09-17T00:52:09.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:09 smithi071 ceph-mon[23769]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T00:52:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:52:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-09-17T00:52:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "initialized": true 2024-09-17T00:52:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: mgrmap e6: y(active, starting, since 0.557432s) 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: Manager daemon y is now available 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:10.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:10.582 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:10.582 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:10.582 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:10.582 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:52:10.582 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:52:10.878 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:52:10] ENGINE Bus STARTING 2024-09-17T00:52:10.878 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:52:10] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:52:10.878 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:52:10] ENGINE Bus STARTED 2024-09-17T00:52:10.880 INFO:teuthology.orchestra.run.smithi071.stderr:mgr epoch 5 is available 2024-09-17T00:52:10.880 INFO:teuthology.orchestra.run.smithi071.stderr:Setting orchestrator backend to cephadm... 2024-09-17T00:52:11.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:11 smithi071 ceph-mon[23769]: mgrmap e7: y(active, since 1.56025s) 2024-09-17T00:52:11.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:11 smithi071 ceph-mon[23769]: [17/Sep/2024:00:52:10] ENGINE Bus STARTING 2024-09-17T00:52:11.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:11 smithi071 ceph-mon[23769]: [17/Sep/2024:00:52:10] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:52:11.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:11 smithi071 ceph-mon[23769]: [17/Sep/2024:00:52:10] ENGINE Bus STARTED 2024-09-17T00:52:11.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:11 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:11.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:11 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:12.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:12 smithi071 ceph-mon[23769]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:12.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:12 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:12.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:12 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:12.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:12 smithi071 ceph-mon[23769]: mgrmap e8: y(active, since 2s) 2024-09-17T00:52:12.645 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: value unchanged 2024-09-17T00:52:13.226 INFO:teuthology.orchestra.run.smithi071.stderr:Generating ssh key... 2024-09-17T00:52:13.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:13 smithi071 ceph-mon[23769]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:14.504 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: Generating public/private rsa key pair. 2024-09-17T00:52:14.504 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: Your identification has been saved in /tmp/tmprzdowysi/key. 2024-09-17T00:52:14.504 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: Your public key has been saved in /tmp/tmprzdowysi/key.pub. 2024-09-17T00:52:14.504 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: The key fingerprint is: 2024-09-17T00:52:14.504 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: SHA256:VZrY4xVdy23BW5KEiigFUr1CeQ/uRDT0ApwWx4uFftU ceph-e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: The key's randomart image is: 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: +---[RSA 3072]----+ 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | .o=@= . o+o+.| 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | .BoOo.oE+..=.=| 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | + B.Bo.*.. +=| 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | = B.oo.o o | 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | * S . | 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | . | 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | | 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | | 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: | | 2024-09-17T00:52:14.505 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: +----[SHA256]-----+ 2024-09-17T00:52:15.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:15 smithi071 ceph-mon[23769]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:15.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:15 smithi071 ceph-mon[23769]: Generating ssh key... 2024-09-17T00:52:15.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:15 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:15.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:15 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:15.367 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNcdwvVBnmozIdtn6qtCuQ8CTZ5j/L89f4hVh5foqB1LmQgh/UHmDQBYgDHyChlhoomET0pfSIim2zakm8KPeggkz4jfyYfuYdvXLWrhopQjb+XklzeJDLTJtaF6kcIM+e1Wx4FNPf4HegyxQbp2M0O7WUEAldw6iw6kbgCvbObSMN7RGgdMlsCTU4w1AjHhUyDLKnbu9Iudh6czRT35o+XNWxBFeaDBOwRQq5Ohh0zkIGcZY70kKxMJYRZ00ejcp0JYhjyijblUIhcUjAy/DoF7mtbjfDK2xKHO+AsyrMEpLtBm2SyqJYe4dlw0YWyvjeWUo3h9txeEHmF7mjK+E0rFhZT0RahGY4ZCnu+5TvSqIKMaUHibDQw8an5Am4c0rkOHbtz89FEEa6lvmyPLghGx6d4ByhGE5C7BNgCtHROTede5BZdOE2RnLEsWUy+56HCNne9mGQstJDPt3Lp7rdVj7ENulMo1U+R26NzEVE0MiiONS65li8Gv9Kc0OGVS8= ceph-e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:15.879 INFO:teuthology.orchestra.run.smithi071.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T00:52:15.880 INFO:teuthology.orchestra.run.smithi071.stderr:Adding key to root@localhost authorized_keys... 2024-09-17T00:52:15.890 INFO:teuthology.orchestra.run.smithi071.stderr:Adding host smithi071... 2024-09-17T00:52:16.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:16 smithi071 ceph-mon[23769]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:17.414 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: Added host 'smithi071' with addr '172.21.15.71' 2024-09-17T00:52:17.426 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:17 smithi071 ceph-mon[23769]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "addr": "172.21.15.71", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:18.013 INFO:teuthology.orchestra.run.smithi071.stderr:Deploying unmanaged mon service... 2024-09-17T00:52:18.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:18 smithi071 ceph-mon[23769]: Deploying cephadm binary to smithi071 2024-09-17T00:52:18.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:18 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:18.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:18 smithi071 ceph-mon[23769]: Added host smithi071 2024-09-17T00:52:18.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:18 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:18.589 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: Scheduled mon update... 2024-09-17T00:52:19.361 INFO:teuthology.orchestra.run.smithi071.stderr:Deploying unmanaged mgr service... 2024-09-17T00:52:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:19 smithi071 ceph-mon[23769]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:19 smithi071 ceph-mon[23769]: Saving service mon spec with placement count:5 2024-09-17T00:52:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:19 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:20.032 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-09-17T00:52:21.347 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:21 smithi071 ceph-mon[23769]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:21.347 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:21 smithi071 ceph-mon[23769]: Saving service mgr spec with placement count:2 2024-09-17T00:52:21.347 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:21 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:22.590 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:22 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1213779239' entity='client.admin' 2024-09-17T00:52:22.590 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:22 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:22.590 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:22 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:Enabling the dashboard module... 2024-09-17T00:52:24.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:23 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2753985024' entity='client.admin' 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/520657770' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: from='mgr.14120 172.21.15.71:0/3100676320' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]': finished 2024-09-17T00:52:25.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:24 smithi071 ceph-mon[23769]: Deploying daemon agent.smithi071 on smithi071 2024-09-17T00:52:25.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setuser ceph since I am not root 2024-09-17T00:52:25.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setgroup ceph since I am not root 2024-09-17T00:52:25.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:25.156+0000 7fd25097f000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T00:52:25.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:25.236+0000 7fd25097f000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T00:52:25.743 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:25.411+0000 7fd25097f000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T00:52:25.743 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:25.500+0000 7fd25097f000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T00:52:25.743 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:25.638+0000 7fd25097f000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:52:25.997 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:25.855+0000 7fd25097f000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T00:52:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:52:26.212 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "epoch": 9, 2024-09-17T00:52:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "available": true, 2024-09-17T00:52:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "active_name": "y", 2024-09-17T00:52:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "num_standby": 0 2024-09-17T00:52:26.213 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:52:26.289 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:26 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/520657770' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T00:52:26.290 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:26 smithi071 ceph-mon[23769]: mgrmap e9: y(active, since 16s) 2024-09-17T00:52:26.290 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:26.191+0000 7fd25097f000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T00:52:26.290 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:26.291+0000 7fd25097f000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T00:52:26.591 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:26.456+0000 7fd25097f000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T00:52:26.868 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for the mgr to restart... 2024-09-17T00:52:26.868 INFO:teuthology.orchestra.run.smithi071.stderr:Waiting for mgr epoch 9... 2024-09-17T00:52:27.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:27 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1226498301' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T00:52:27.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:27.547+0000 7fd25097f000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T00:52:27.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:27.637+0000 7fd25097f000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T00:52:28.831 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:28.528+0000 7fd25097f000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T00:52:29.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:28.832+0000 7fd25097f000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T00:52:29.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:28.965+0000 7fd25097f000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:52:29.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.054+0000 7fd25097f000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T00:52:29.478 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.151+0000 7fd25097f000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T00:52:29.478 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.238+0000 7fd25097f000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T00:52:29.478 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.386+0000 7fd25097f000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T00:52:29.478 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.479+0000 7fd25097f000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T00:52:29.857 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.576+0000 7fd25097f000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T00:52:30.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.858+0000 7fd25097f000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T00:52:30.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:29.946+0000 7fd25097f000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T00:52:30.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:30 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:30.034+0000 7fd25097f000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T00:52:31.355 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:31 smithi071 ceph-mon[23769]: Active manager daemon y restarted 2024-09-17T00:52:31.356 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:31 smithi071 ceph-mon[23769]: Activating manager daemon y 2024-09-17T00:52:31.356 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:31 smithi071 ceph-mon[23769]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T00:52:31.356 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:52:31.103+0000 7fd25097f000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T00:52:31.356 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:52:31] ENGINE Bus STARTING 2024-09-17T00:52:31.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:52:31] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:52:31.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:52:31] ENGINE Bus STARTED 2024-09-17T00:52:32.173 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: { 2024-09-17T00:52:32.173 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-09-17T00:52:32.173 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: "initialized": true 2024-09-17T00:52:32.173 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: } 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: mgrmap e10: y(active, starting, since 0.0554196s) 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: Manager daemon y is now available 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:52:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:52:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: [17/Sep/2024:00:52:31] ENGINE Bus STARTING 2024-09-17T00:52:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: [17/Sep/2024:00:52:31] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:52:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: [17/Sep/2024:00:52:31] ENGINE Bus STARTED 2024-09-17T00:52:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:33.012 INFO:teuthology.orchestra.run.smithi071.stderr:mgr epoch 9 is available 2024-09-17T00:52:33.012 INFO:teuthology.orchestra.run.smithi071.stderr:Generating a dashboard self-signed certificate... 2024-09-17T00:52:33.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T00:52:33.283 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: mgrmap e11: y(active, since 1.06383s) 2024-09-17T00:52:33.283 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T00:52:33.283 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:33.283 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:52:33.283 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:33.283 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T00:52:33.283 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:33 smithi071 ceph-mon[23769]: Deploying daemon agent.smithi071 on smithi071 2024-09-17T00:52:33.813 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: Self-signed certificate created 2024-09-17T00:52:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:Creating initial admin user... 2024-09-17T00:52:34.801 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:34 smithi071 ceph-mon[23769]: mgrmap e12: y(active, since 2s) 2024-09-17T00:52:34.801 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:34 smithi071 ceph-mon[23769]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:34.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:34 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:34.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:34 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:35.213 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$.0WPdzvX7W/7pUl/rElR5eoEBC5Qie1nK42sweRWgEcKgqaP5OGxi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726534355, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T00:52:35.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:35 smithi071 ceph-mon[23769]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:35.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:35.915 INFO:teuthology.orchestra.run.smithi071.stderr:Fetching dashboard port number... 2024-09-17T00:52:36.588 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: 8443 2024-09-17T00:52:36.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:36 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2525130843' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T00:52:37.326 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: disabled 2024-09-17T00:52:37.333 INFO:teuthology.orchestra.run.smithi071.stderr:systemctl: inactive 2024-09-17T00:52:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:firewalld.service is not enabled 2024-09-17T00:52:37.334 INFO:teuthology.orchestra.run.smithi071.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T00:52:37.336 INFO:teuthology.orchestra.run.smithi071.stderr:Ceph Dashboard is now available at: 2024-09-17T00:52:37.336 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:37.337 INFO:teuthology.orchestra.run.smithi071.stderr: URL: https://smithi071.front.sepia.ceph.com:8443/ 2024-09-17T00:52:37.337 INFO:teuthology.orchestra.run.smithi071.stderr: User: admin 2024-09-17T00:52:37.337 INFO:teuthology.orchestra.run.smithi071.stderr: Password: fooud05h48 2024-09-17T00:52:37.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:37.337 INFO:teuthology.orchestra.run.smithi071.stderr:Enabling autotune for osd_memory_target 2024-09-17T00:52:38.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:38 smithi071 ceph-mon[23769]: mgrmap e13: y(active, since 6s) 2024-09-17T00:52:39.386 INFO:teuthology.orchestra.run.smithi071.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr:You can access the Ceph CLI with: 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr:Please consider enabling telemetry to help improve Ceph: 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr: ceph telemetry on 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr:For more information see: 2024-09-17T00:52:40.088 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:40.089 INFO:teuthology.orchestra.run.smithi071.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-17T00:52:40.089 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T00:52:40.089 INFO:teuthology.orchestra.run.smithi071.stderr:Bootstrap complete. 2024-09-17T00:52:40.123 INFO:tasks.cephadm:Fetching config... 2024-09-17T00:52:40.123 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:52:40.124 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T00:52:40.140 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T00:52:40.140 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:52:40.140 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T00:52:40.196 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T00:52:40.197 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:52:40.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-17T00:52:40.286 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T00:52:40.286 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:52:40.286 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T00:52:40.341 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T00:52:40.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNcdwvVBnmozIdtn6qtCuQ8CTZ5j/L89f4hVh5foqB1LmQgh/UHmDQBYgDHyChlhoomET0pfSIim2zakm8KPeggkz4jfyYfuYdvXLWrhopQjb+XklzeJDLTJtaF6kcIM+e1Wx4FNPf4HegyxQbp2M0O7WUEAldw6iw6kbgCvbObSMN7RGgdMlsCTU4w1AjHhUyDLKnbu9Iudh6czRT35o+XNWxBFeaDBOwRQq5Ohh0zkIGcZY70kKxMJYRZ00ejcp0JYhjyijblUIhcUjAy/DoF7mtbjfDK2xKHO+AsyrMEpLtBm2SyqJYe4dlw0YWyvjeWUo3h9txeEHmF7mjK+E0rFhZT0RahGY4ZCnu+5TvSqIKMaUHibDQw8an5Am4c0rkOHbtz89FEEa6lvmyPLghGx6d4ByhGE5C7BNgCtHROTede5BZdOE2RnLEsWUy+56HCNne9mGQstJDPt3Lp7rdVj7ENulMo1U+R26NzEVE0MiiONS65li8Gv9Kc0OGVS8= ceph-e9235fcc-748e-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T00:52:40.497 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNcdwvVBnmozIdtn6qtCuQ8CTZ5j/L89f4hVh5foqB1LmQgh/UHmDQBYgDHyChlhoomET0pfSIim2zakm8KPeggkz4jfyYfuYdvXLWrhopQjb+XklzeJDLTJtaF6kcIM+e1Wx4FNPf4HegyxQbp2M0O7WUEAldw6iw6kbgCvbObSMN7RGgdMlsCTU4w1AjHhUyDLKnbu9Iudh6czRT35o+XNWxBFeaDBOwRQq5Ohh0zkIGcZY70kKxMJYRZ00ejcp0JYhjyijblUIhcUjAy/DoF7mtbjfDK2xKHO+AsyrMEpLtBm2SyqJYe4dlw0YWyvjeWUo3h9txeEHmF7mjK+E0rFhZT0RahGY4ZCnu+5TvSqIKMaUHibDQw8an5Am4c0rkOHbtz89FEEa6lvmyPLghGx6d4ByhGE5C7BNgCtHROTede5BZdOE2RnLEsWUy+56HCNne9mGQstJDPt3Lp7rdVj7ENulMo1U+R26NzEVE0MiiONS65li8Gv9Kc0OGVS8= ceph-e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:40.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNcdwvVBnmozIdtn6qtCuQ8CTZ5j/L89f4hVh5foqB1LmQgh/UHmDQBYgDHyChlhoomET0pfSIim2zakm8KPeggkz4jfyYfuYdvXLWrhopQjb+XklzeJDLTJtaF6kcIM+e1Wx4FNPf4HegyxQbp2M0O7WUEAldw6iw6kbgCvbObSMN7RGgdMlsCTU4w1AjHhUyDLKnbu9Iudh6czRT35o+XNWxBFeaDBOwRQq5Ohh0zkIGcZY70kKxMJYRZ00ejcp0JYhjyijblUIhcUjAy/DoF7mtbjfDK2xKHO+AsyrMEpLtBm2SyqJYe4dlw0YWyvjeWUo3h9txeEHmF7mjK+E0rFhZT0RahGY4ZCnu+5TvSqIKMaUHibDQw8an5Am4c0rkOHbtz89FEEa6lvmyPLghGx6d4ByhGE5C7BNgCtHROTede5BZdOE2RnLEsWUy+56HCNne9mGQstJDPt3Lp7rdVj7ENulMo1U+R26NzEVE0MiiONS65li8Gv9Kc0OGVS8= ceph-e9235fcc-748e-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T00:52:40.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:40 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/539132463' entity='client.admin' 2024-09-17T00:52:40.693 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNcdwvVBnmozIdtn6qtCuQ8CTZ5j/L89f4hVh5foqB1LmQgh/UHmDQBYgDHyChlhoomET0pfSIim2zakm8KPeggkz4jfyYfuYdvXLWrhopQjb+XklzeJDLTJtaF6kcIM+e1Wx4FNPf4HegyxQbp2M0O7WUEAldw6iw6kbgCvbObSMN7RGgdMlsCTU4w1AjHhUyDLKnbu9Iudh6czRT35o+XNWxBFeaDBOwRQq5Ohh0zkIGcZY70kKxMJYRZ00ejcp0JYhjyijblUIhcUjAy/DoF7mtbjfDK2xKHO+AsyrMEpLtBm2SyqJYe4dlw0YWyvjeWUo3h9txeEHmF7mjK+E0rFhZT0RahGY4ZCnu+5TvSqIKMaUHibDQw8an5Am4c0rkOHbtz89FEEa6lvmyPLghGx6d4ByhGE5C7BNgCtHROTede5BZdOE2RnLEsWUy+56HCNne9mGQstJDPt3Lp7rdVj7ENulMo1U+R26NzEVE0MiiONS65li8Gv9Kc0OGVS8= ceph-e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:40.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T00:52:41.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:52:41] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:52:42.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:42.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:42.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:42.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:42.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:42.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:42.282 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:43.613 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T00:52:43.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T00:52:44.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:43 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3160615657' entity='client.admin' 2024-09-17T00:52:44.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:43 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:44.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:43 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:46.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:52:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:52:47.099 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:52:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:52:47.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:47 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:47.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:47 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:47.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:47 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:47.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:47 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:48.103 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2024-09-17T00:52:48.103 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-17T00:52:48.103 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2024-09-17T00:52:48.122 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-17T00:52:48.122 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:52:48.180 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2024-09-17T00:52:48.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch host add smithi135 2024-09-17T00:52:48.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:50.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:50 smithi071 ceph-mon[23769]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:52:50.910 INFO:teuthology.orchestra.run.smithi071.stdout:Added host 'smithi135' with addr '172.21.15.135' 2024-09-17T00:52:51.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T00:52:52.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: Deploying cephadm binary to smithi135 2024-09-17T00:52:52.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:52.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: Added host smithi135 2024-09-17T00:52:52.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:52.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:52:52.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:52:52.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:52.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:52.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:52.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:52:52.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:52.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T00:52:52.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]': finished 2024-09-17T00:52:52.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:52 smithi071 ceph-mon[23769]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:52:52.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:52.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:52.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:52:52.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:52:53.378 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:52:53.378 INFO:teuthology.orchestra.run.smithi071.stdout:[{"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2024-09-17T00:52:53.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:52:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:52:54.001 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T00:52:54.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T00:52:54.287 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: Deploying daemon agent.smithi135 on smithi135 2024-09-17T00:52:54.287 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T00:52:54.287 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:52:54.287 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:54.287 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:54.287 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:52:54.287 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:52:54.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:52:54.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:54.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:54.581 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:52:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:52:55.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:55 smithi071 ceph-mon[23769]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:52:55.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:55 smithi071 ceph-mon[23769]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:52:55.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:55 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:55.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:55 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:55.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:52:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:52:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:52:56.577 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-09-17T00:52:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:56 smithi071 ceph-mon[23769]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:52:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:56 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:56 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:56 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1489332245' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T00:52:56.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:56 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:52:57.148 INFO:tasks.cephadm:Adding mon.a on smithi071 2024-09-17T00:52:57.148 INFO:tasks.cephadm:Adding mon.c on smithi071 2024-09-17T00:52:57.148 INFO:tasks.cephadm:Adding mon.b on smithi135 2024-09-17T00:52:57.148 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi071:172.21.15.71=a;smithi071:[v2:172.21.15.71:3301,v1:172.21.15.71:6790]=c;smithi135:172.21.15.135=b' 2024-09-17T00:52:57.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:57 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1489332245' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T00:52:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:57 smithi071 ceph-mon[23769]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:52:58.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:52:58 smithi071 ceph-mon[23769]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:52:59.043 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mon update... 2024-09-17T00:52:59.657 DEBUG:teuthology.orchestra.run.smithi071:mon.c> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.c.service 2024-09-17T00:52:59.659 DEBUG:teuthology.orchestra.run.smithi135:mon.b> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.b.service 2024-09-17T00:52:59.662 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T00:52:59.662 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi071:172.21.15.71=a;smithi071:[v2:172.21.15.71:3301,v1:172.21.15.71:6790]=c;smithi135:172.21.15.135=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: Saving service mon spec with placement smithi071:172.21.15.71=a;smithi071:[v2:172.21.15.71:3301,v1:172.21.15.71:6790]=c;smithi135:172.21.15.135=b;count:3 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:01.302 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:01 smithi071 ceph-mon[23769]: Deploying daemon mon.c on smithi071 2024-09-17T00:53:01.302 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:01 smithi071 ceph-mon[23769]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:01.583 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:53:01.583 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"e9235fcc-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:51:39.765300Z","created":"2024-09-17T00:51:39.765300Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:53:01.585 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-17T00:53:01.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:01 smithi071 systemd[1]: Starting Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:53:02.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/4070113905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:53:02.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:01 smithi071 podman[28565]: 2024-09-17 00:53:01.865425178 +0000 UTC m=+0.097789363 container create 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, RELEASE=HEAD, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, maintainer=Guillaume Abrioux , architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, io.buildah.version=1.19.8, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, ceph=True, io.k8s.display-name=CentOS Stream 8) 2024-09-17T00:53:02.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:01 smithi071 podman[28565]: 2024-09-17 00:53:01.784243516 +0000 UTC m=+0.016607718 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-09-17T00:53:02.467 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 podman[28565]: 2024-09-17 00:53:02.286328779 +0000 UTC m=+0.518692981 container init 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, name=centos-stream, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, vcs-type=git, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, io.openshift.expose-services=, maintainer=Guillaume Abrioux , architecture=x86_64, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0) 2024-09-17T00:53:02.468 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 podman[28565]: 2024-09-17 00:53:02.289522277 +0000 UTC m=+0.521886463 container start 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, version=8, GIT_BRANCH=HEAD, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, release=754, io.k8s.display-name=CentOS Stream 8, name=centos-stream, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, RELEASE=HEAD, io.buildah.version=1.19.8) 2024-09-17T00:53:02.468 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T00:53:02.468 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-09-17T00:53:02.468 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: pidfile_write: ignore empty --pid-file 2024-09-17T00:53:02.468 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: load: jerasure load: lrc 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: RocksDB version: 6.15.5 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Compile date Apr 18 2022 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: DB SUMMARY 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: DB Session ID: N254YJIRPO18Z0TA8JBQ 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: CURRENT file: CURRENT 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-17T00:53:02.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.error_if_exists: 0 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.create_if_missing: 0 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.paranoid_checks: 1 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.env: 0x55833eac6860 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.fs: Posix File System 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.info_log: 0x5583401efdc0 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.statistics: (nil) 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.use_fsync: 0 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_log_file_size: 0 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T00:53:02.470 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.allow_fallocate: 1 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.use_direct_reads: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.db_log_dir: 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T00:53:02.471 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.write_buffer_manager: 0x5583402e02d0 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T00:53:02.472 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.unordered_write: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.row_cache: None 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.wal_filter: None 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.preserve_deletes: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.two_write_queues: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.atomic_flush: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T00:53:02.473 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.log_readahead_size: 0 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_background_jobs: 2 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_background_compactions: -1 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_subcompactions: 1 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T00:53:02.474 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_open_files: -1 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_background_flushes: -1 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Compression algorithms supported: 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T00:53:02.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kZSTD supported: 0 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kXpressCompression supported: 0 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kLZ4Compression supported: 1 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kBZip2Compression supported: 0 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kZlibCompression supported: 1 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: kSnappyCompression supported: 1 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.merge_operator: 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_filter: None 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T00:53:02.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5583401bbd00) 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_type: 0 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: data_block_index_type: 0 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_shortening: 1 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: hash_index_allow_collision: 1 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: checksum: 1 2024-09-17T00:53:02.477 INFO:journalctl@ceph.mon.c.smithi071.stdout: no_block_cache: 0 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache: 0x558340226170 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_options: 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: capacity : 536870912 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: num_shard_bits : 4 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: strict_capacity_limit : 0 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_compressed: (nil) 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: persistent_cache: (nil) 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_size: 4096 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_size_deviation: 10 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_restart_interval: 16 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_block_restart_interval: 1 2024-09-17T00:53:02.478 INFO:journalctl@ceph.mon.c.smithi071.stdout: metadata_block_size: 4096 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: partition_filters: 0 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: use_delta_encoding: 1 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: whole_key_filtering: 1 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: verify_compression: 0 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: format_version: 4 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: enable_index_compression: 1 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_align: 0 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression: NoCompression 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T00:53:02.479 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.num_levels: 7 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T00:53:02.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T00:53:02.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T00:53:02.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T00:53:02.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:53:02.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T00:53:02.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T00:53:02.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.arena_block_size: 4194304 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T00:53:02.483 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.table_properties_collectors: 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.inplace_update_support: 0 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T00:53:02.484 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.bloom_locality: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.max_successive_merges: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.ttl: 2592000 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.enable_blob_files: false 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.min_blob_size: 0 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T00:53:02.485 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534382315924, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534382316212, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726534382, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "5010cb03-0d7f-48ad-958e-c69ab738895a", "db_session_id": "N254YJIRPO18Z0TA8JBQ"}} 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534382316505, "job": 1, "event": "recovery_finished"} 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55834020ca80 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: DB pointer 0x55834021c000 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-09-17T00:53:02.486 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** DB Stats ** 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:53:02.487 INFO:journalctl@ceph.mon.c.smithi071.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:53:02.488 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:53:02.489 INFO:journalctl@ceph.mon.c.smithi071.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:53:02.490 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: using public_addrv [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: starting mon.c rank -1 at public addrs [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] at bind addrs [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(???) e0 preinit fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).mds e1 new map 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: e1 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: legacy client fscid: -1 2024-09-17T00:53:02.491 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout: No filesystems configured 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1489332245' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T00:53:02.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi071:172.21.15.71=a;smithi071:[v2:172.21.15.71:3301,v1:172.21.15.71:6790]=c;smithi135:172.21.15.135=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: Saving service mon spec with placement smithi071:172.21.15.71=a;smithi071:[v2:172.21.15.71:3301,v1:172.21.15.71:6790]=c;smithi135:172.21.15.135=b;count:3 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: Deploying daemon mon.c on smithi071 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/4070113905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:53:02.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-09-17T00:53:02.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 ceph-mon[28615]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-09-17T00:53:02.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 bash[28565]: 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 2024-09-17T00:53:02.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:02 smithi071 systemd[1]: Started Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:53:03.211 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T00:53:03.211 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:53:07.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:53:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: mon.a calling monitor election 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: mon.c calling monitor election 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: monmap e2: 2 mons at {a=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],c=[v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0]} 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: fsmap 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: mgrmap e13: y(active, since 36s) 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: overall HEALTH_OK 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:53:07.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: mon.a calling monitor election 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: mon.c calling monitor election 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: monmap e2: 2 mons at {a=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],c=[v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0]} 2024-09-17T00:53:07.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: fsmap 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: mgrmap e13: y(active, since 36s) 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: overall HEALTH_OK 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:07.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:08.049 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:53:08.049 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"e9235fcc-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:53:02.336049Z","created":"2024-09-17T00:51:39.765300Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T00:53:08.052 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-09-17T00:53:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[23769]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[23769]: Deploying daemon mon.b on smithi135 2024-09-17T00:53:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/3919230365' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:53:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:08.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[28615]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:08.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[28615]: Deploying daemon mon.b on smithi135 2024-09-17T00:53:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/3919230365' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:53:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:09.706 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T00:53:09.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:53:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:10 smithi071 ceph-mon[23769]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:10.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:10 smithi071 ceph-mon[28615]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:53:11.901 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"e9235fcc-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:53:02.336049Z","created":"2024-09-17T00:51:39.765300Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T00:53:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-09-17T00:53:13.766 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T00:53:13.766 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:53:17.357 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:53:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:17.357 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:53:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:17.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:53:17.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: mon.a calling monitor election 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: mon.c calling monitor election 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: mon.b calling monitor election 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T00:53:17.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: monmap e3: 3 mons at {a=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0]} 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: fsmap 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: mgrmap e13: y(active, since 45s) 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: overall HEALTH_OK 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:53:17.359 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: mon.a calling monitor election 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: mon.c calling monitor election 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: mon.b calling monitor election 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: monmap e3: 3 mons at {a=[v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0],b=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0],c=[v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0]} 2024-09-17T00:53:17.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: fsmap 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: mgrmap e13: y(active, since 45s) 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: overall HEALTH_OK 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:17.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:17 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:17.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:53:17.610 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"fsid":"e9235fcc-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:53:12.085085Z","created":"2024-09-17T00:51:39.765300Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-17T00:53:17.610 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 3 2024-09-17T00:53:18.238 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T00:53:18.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: Reconfiguring mon.a (unknown last config time)... 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: Reconfiguring daemon mon.a on smithi071 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/371472617' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T00:53:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: Reconfiguring mon.a (unknown last config time)... 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: Reconfiguring daemon mon.a on smithi071 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/371472617' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:53:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:53:19.384 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:53:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:19.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:53:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:20.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: Reconfiguring mon.c (monmap changed)... 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:20.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:53:20.368 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:20.368 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[23769]: Reconfiguring daemon mon.c on smithi071 2024-09-17T00:53:20.368 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.368 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.368 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:20.368 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.368 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:20.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: Reconfiguring mon.c (monmap changed)... 2024-09-17T00:53:20.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:20.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:53:20.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:20.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-mon[28615]: Reconfiguring daemon mon.c on smithi071 2024-09-17T00:53:21.237 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:20 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:53:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:# minimal ceph.conf for e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:53:21.418 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-09-17T00:53:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T00:53:21.418 INFO:teuthology.orchestra.run.smithi071.stdout: mon_host = [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-17T00:53:22.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:21 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1575449989' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:22.225 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:22.225 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:22.225 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:22.225 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1575449989' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:22.225 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:22.226 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:22.226 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:22.226 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:21 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1575449989' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:22.291 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T00:53:22.292 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:53:22.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T00:53:22.320 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:53:22.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:53:22.385 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-17T00:53:22.385 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T00:53:22.419 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-17T00:53:22.419 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:53:22.488 INFO:tasks.cephadm:Adding mgr.y on smithi071 2024-09-17T00:53:22.488 INFO:tasks.cephadm:Adding mgr.x on smithi135 2024-09-17T00:53:22.488 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch apply mgr '2;smithi071=y;smithi135=x' 2024-09-17T00:53:23.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:22 smithi135 ceph-mon[24697]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:23.140 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:22 smithi071 ceph-mon[23769]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:23.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:22 smithi071 ceph-mon[28615]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:23.141 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:53:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:24.121 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:24.121 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:24.121 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:24 smithi071 ceph-mon[23769]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:24.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:24.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:24.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:24 smithi071 ceph-mon[28615]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:24.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:24.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:24.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:24 smithi135 ceph-mon[24697]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:24.293 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mgr update... 2024-09-17T00:53:24.916 DEBUG:teuthology.orchestra.run.smithi135:mgr.x> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service 2024-09-17T00:53:24.920 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T00:53:24.920 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:53:24.920 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T00:53:24.940 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T00:53:24.941 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-17T00:53:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T00:53:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T00:53:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:25.001 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-17 00:53:22.149987701 +0000 2024-09-17T00:53:25.001 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-17 00:50:41.696946441 +0000 2024-09-17T00:53:25.001 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-17 00:50:41.696946441 +0000 2024-09-17T00:53:25.001 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-17 00:50:41.696946441 +0000 2024-09-17T00:53:25.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T00:53:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-17T00:53:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-17T00:53:25.069 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000290551 s, 1.8 MB/s 2024-09-17T00:53:25.071 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T00:53:25.131 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-17T00:53:25.190 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T00:53:25.190 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:25.190 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T00:53:25.190 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:25.190 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:25.190 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-17 00:53:22.149987701 +0000 2024-09-17T00:53:25.191 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-17 00:50:42.020940711 +0000 2024-09-17T00:53:25.191 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-17 00:50:42.020940711 +0000 2024-09-17T00:53:25.191 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-17 00:50:42.020940711 +0000 2024-09-17T00:53:25.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T00:53:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-17T00:53:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-17T00:53:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000231859 s, 2.2 MB/s 2024-09-17T00:53:25.258 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T00:53:25.316 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-17T00:53:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T00:53:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:25.374 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T00:53:25.374 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:25.374 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:25.374 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-17 00:53:22.149987701 +0000 2024-09-17T00:53:25.374 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-17 00:50:42.348934909 +0000 2024-09-17T00:53:25.375 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-17 00:50:42.348934909 +0000 2024-09-17T00:53:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-17 00:50:42.348934909 +0000 2024-09-17T00:53:25.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T00:53:25.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: Reconfiguring mon.b (monmap changed)... 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: Reconfiguring daemon mon.b on smithi135 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi071=y;smithi135=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: Saving service mgr spec with placement smithi071=y;smithi135=x;count:2 2024-09-17T00:53:25.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: Reconfiguring mon.b (monmap changed)... 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: Reconfiguring daemon mon.b on smithi135 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi071=y;smithi135=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: Saving service mgr spec with placement smithi071=y;smithi135=x;count:2 2024-09-17T00:53:25.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:25 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:25.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:25.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: Reconfiguring mon.b (monmap changed)... 2024-09-17T00:53:25.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:53:25.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:53:25.403 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:25.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: Reconfiguring daemon mon.b on smithi135 2024-09-17T00:53:25.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi071=y;smithi135=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:25.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: Saving service mgr spec with placement smithi071=y;smithi135=x;count:2 2024-09-17T00:53:25.404 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:25 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:25.422 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-17T00:53:25.422 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-17T00:53:25.422 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00021117 s, 2.4 MB/s 2024-09-17T00:53:25.423 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T00:53:25.480 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-17T00:53:25.536 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T00:53:25.536 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:25.536 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T00:53:25.537 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:25.537 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:25.537 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-17 00:53:22.149987701 +0000 2024-09-17T00:53:25.537 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-17 00:50:42.673929160 +0000 2024-09-17T00:53:25.537 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-17 00:50:42.673929160 +0000 2024-09-17T00:53:25.537 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-17 00:50:42.673929160 +0000 2024-09-17T00:53:25.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T00:53:25.600 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-17T00:53:25.601 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-17T00:53:25.601 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000195369 s, 2.6 MB/s 2024-09-17T00:53:25.602 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T00:53:25.659 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-17T00:53:25.659 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T00:53:25.675 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T00:53:25.675 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-17T00:53:25.731 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-17 00:53:20.265228106 +0000 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-17 00:50:34.831355962 +0000 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-17 00:50:34.831355962 +0000 2024-09-17T00:53:25.732 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-17 00:50:34.831355962 +0000 2024-09-17T00:53:25.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T00:53:25.796 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-17T00:53:25.796 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-17T00:53:25.796 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.0001976 s, 2.6 MB/s 2024-09-17T00:53:25.797 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T00:53:25.854 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-17T00:53:25.910 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T00:53:25.910 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:25.910 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T00:53:25.911 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:25.911 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:25.911 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-17 00:53:20.265228106 +0000 2024-09-17T00:53:25.911 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-17 00:50:35.159349286 +0000 2024-09-17T00:53:25.911 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-17 00:50:35.159349286 +0000 2024-09-17T00:53:25.911 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-17 00:50:35.159349286 +0000 2024-09-17T00:53:25.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T00:53:25.973 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-17T00:53:25.974 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-17T00:53:25.974 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000203492 s, 2.5 MB/s 2024-09-17T00:53:25.975 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T00:53:26.032 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-17T00:53:26.088 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-17 00:53:20.265228106 +0000 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-17 00:50:35.485342651 +0000 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-17 00:50:35.485342651 +0000 2024-09-17T00:53:26.089 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-17 00:50:35.485342651 +0000 2024-09-17T00:53:26.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T00:53:26.152 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-17T00:53:26.153 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-17T00:53:26.153 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000180347 s, 2.8 MB/s 2024-09-17T00:53:26.154 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T00:53:26.211 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-17T00:53:26.269 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T00:53:26.269 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:53:26.269 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T00:53:26.269 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:53:26.269 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:53:26.269 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-17 00:53:20.265228106 +0000 2024-09-17T00:53:26.270 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-17 00:50:35.816335914 +0000 2024-09-17T00:53:26.270 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-17 00:50:35.816335914 +0000 2024-09-17T00:53:26.270 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-17 00:50:35.816335914 +0000 2024-09-17T00:53:26.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T00:53:26.334 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-17T00:53:26.335 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-17T00:53:26.335 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00019801 s, 2.6 MB/s 2024-09-17T00:53:26.336 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T00:53:26.393 INFO:tasks.cephadm:Deploying osd.0 on smithi071 with /dev/vg_nvme/lv_4... 2024-09-17T00:53:26.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T00:53:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:53:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:53:27.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:28.052 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:27 smithi135 systemd[1]: Starting Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:53:28.350 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:28 smithi135 ceph-mon[24697]: Deploying daemon mgr.x on smithi135 2024-09-17T00:53:28.350 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 podman[26240]: 2024-09-17 00:53:27.963600633 +0000 UTC m=+0.016337758 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-09-17T00:53:28.350 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 podman[26240]: 2024-09-17 00:53:28.067267315 +0000 UTC m=+0.120004470 container create 3e09849f10bc62ae017bf011ec890a4cdded5c6ab2270f194aad7b4230d933de (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, distribution-scope=public, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, RELEASE=HEAD, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, architecture=x86_64, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., version=8) 2024-09-17T00:53:28.350 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 podman[26240]: 2024-09-17 00:53:28.252935766 +0000 UTC m=+0.305672888 container init 3e09849f10bc62ae017bf011ec890a4cdded5c6ab2270f194aad7b4230d933de (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, version=8, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-09-17T00:53:28.350 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 podman[26240]: 2024-09-17 00:53:28.255699786 +0000 UTC m=+0.308436907 container start 3e09849f10bc62ae017bf011ec890a4cdded5c6ab2270f194aad7b4230d933de (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, io.openshift.expose-services=, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, RELEASE=HEAD) 2024-09-17T00:53:28.350 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 ceph-mgr[26259]: -- 172.21.15.135:0/1265072086 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560024ff6340 con 0x560024fcec00 2024-09-17T00:53:28.373 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:28 smithi071 ceph-mon[23769]: Deploying daemon mgr.x on smithi135 2024-09-17T00:53:28.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:28 smithi071 ceph-mon[28615]: Deploying daemon mgr.x on smithi135 2024-09-17T00:53:28.652 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 bash[26240]: 3e09849f10bc62ae017bf011ec890a4cdded5c6ab2270f194aad7b4230d933de 2024-09-17T00:53:28.652 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 systemd[1]: Started Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:53:28.652 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:28.396+0000 7fc08de3e000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T00:53:28.652 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:28.477+0000 7fc08de3e000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T00:53:28.652 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:28.653+0000 7fc08de3e000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T00:53:28.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:28.745+0000 7fc08de3e000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T00:53:28.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:28.882+0000 7fc08de3e000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:53:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:53:28.987 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:53:29.287 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:53:29.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:29 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:29.432 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:29.094+0000 7fc08de3e000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T00:53:29.432 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:53:29.433 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:29.686 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:29.434+0000 7fc08de3e000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T00:53:29.686 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:29.523+0000 7fc08de3e000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T00:53:29.686 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:29.688+0000 7fc08de3e000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T00:53:30.251 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:30.251 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:30 smithi135 ceph-mon[24697]: Reconfiguring mgr.y (unknown last config time)... 2024-09-17T00:53:30.251 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:30 smithi135 ceph-mon[24697]: Reconfiguring daemon mgr.y on smithi071 2024-09-17T00:53:30.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:30 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:30.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:30 smithi071 ceph-mon[23769]: Reconfiguring mgr.y (unknown last config time)... 2024-09-17T00:53:30.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:30 smithi071 ceph-mon[23769]: Reconfiguring daemon mgr.y on smithi071 2024-09-17T00:53:30.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:30 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:30.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:30 smithi071 ceph-mon[28615]: Reconfiguring mgr.y (unknown last config time)... 2024-09-17T00:53:30.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:30 smithi071 ceph-mon[28615]: Reconfiguring daemon mgr.y on smithi071 2024-09-17T00:53:31.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:30.838+0000 7fc08de3e000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T00:53:31.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:30.936+0000 7fc08de3e000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T00:53:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-mon[24697]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[23769]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[28615]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:31.291 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:31.292 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:31.292 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:31.292 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:31.292 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:31.292 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:53:31.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:53:31] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:32.193 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:31 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:31.864+0000 7fc08de3e000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T00:53:32.193 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.194+0000 7fc08de3e000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T00:53:32.193 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:32.193 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:53:32.193 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:32.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:32.195 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:53:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:32.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:32.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:32.198 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:32.198 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:32.459 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.325+0000 7fc08de3e000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:53:32.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.412+0000 7fc08de3e000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T00:53:32.830 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.509+0000 7fc08de3e000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T00:53:32.830 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.595+0000 7fc08de3e000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T00:53:32.830 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.741+0000 7fc08de3e000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T00:53:32.831 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.832+0000 7fc08de3e000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T00:53:33.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:32.927+0000 7fc08de3e000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T00:53:33.709 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:33 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:33.217+0000 7fc08de3e000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T00:53:33.709 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:33 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:33.304+0000 7fc08de3e000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T00:53:33.709 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:33 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:33.391+0000 7fc08de3e000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T00:53:34.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[23769]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:34.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2228511220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]: dispatch 2024-09-17T00:53:34.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]: dispatch 2024-09-17T00:53:34.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]': finished 2024-09-17T00:53:34.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[23769]: osdmap e5: 1 total, 0 up, 1 in 2024-09-17T00:53:34.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:34.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[28615]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:34.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2228511220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]: dispatch 2024-09-17T00:53:34.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]: dispatch 2024-09-17T00:53:34.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]': finished 2024-09-17T00:53:34.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[28615]: osdmap e5: 1 total, 0 up, 1 in 2024-09-17T00:53:34.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:34 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:34.709 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:53:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:53:34.457+0000 7fc08de3e000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T00:53:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:34 smithi135 ceph-mon[24697]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:34 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2228511220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]: dispatch 2024-09-17T00:53:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:34 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]: dispatch 2024-09-17T00:53:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:34 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "986e6205-636b-423b-9047-d512ca0fc630"}]': finished 2024-09-17T00:53:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:34 smithi135 ceph-mon[24697]: osdmap e5: 1 total, 0 up, 1 in 2024-09-17T00:53:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:34 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:35.645 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[23769]: Standby manager daemon x started 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2127488361' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[28615]: Standby manager daemon x started 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T00:53:35.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T00:53:35.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T00:53:35.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T00:53:35.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:35 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2127488361' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:53:35.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:35 smithi135 ceph-mon[24697]: Standby manager daemon x started 2024-09-17T00:53:35.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:35 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T00:53:35.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:35 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T00:53:35.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:35 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T00:53:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:35 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3357586981' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T00:53:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:35 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2127488361' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:53:36.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:36 smithi071 ceph-mon[23769]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:36 smithi071 ceph-mon[23769]: mgrmap e14: y(active, since 64s), standbys: x 2024-09-17T00:53:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:36 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T00:53:36.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:36 smithi071 ceph-mon[28615]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:36.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:36 smithi071 ceph-mon[28615]: mgrmap e14: y(active, since 64s), standbys: x 2024-09-17T00:53:36.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:36 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T00:53:36.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:36 smithi135 ceph-mon[24697]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:36.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:36 smithi135 ceph-mon[24697]: mgrmap e14: y(active, since 64s), standbys: x 2024-09-17T00:53:36.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:36 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T00:53:38.635 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:38 smithi071 ceph-mon[23769]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:38.636 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:38 smithi071 ceph-mon[28615]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:38.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:38 smithi135 ceph-mon[24697]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:40.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[23769]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:40.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T00:53:40.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:40.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[23769]: Deploying daemon osd.0 on smithi071 2024-09-17T00:53:40.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[28615]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:40.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T00:53:40.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:40.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:40 smithi071 ceph-mon[28615]: Deploying daemon osd.0 on smithi071 2024-09-17T00:53:40.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:40 smithi135 ceph-mon[24697]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T00:53:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:40 smithi135 ceph-mon[24697]: Deploying daemon osd.0 on smithi071 2024-09-17T00:53:42.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:42 smithi071 ceph-mon[23769]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:42.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:42 smithi071 ceph-mon[28615]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:42.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:42 smithi135 ceph-mon[24697]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:43.576 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:53:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:44.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:44.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:44 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi071 2024-09-17T00:53:44.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:44.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:44 smithi135 ceph-mon[24697]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:44.466 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:44.466 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi071 2024-09-17T00:53:44.466 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:44.466 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[28615]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:44.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:44.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi071 2024-09-17T00:53:44.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:44.467 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:44 smithi071 ceph-mon[23769]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:46.323 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:46 smithi071 ceph-mon[23769]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:46.323 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:46 smithi071 ceph-mon[28615]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:46.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:46 smithi135 ceph-mon[24697]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[23769]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:48.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:48.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:48.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:48.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:48.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:48 smithi071 ceph-mon[28615]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:48.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:48 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:48.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:48 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:48.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:48 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:48.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:48 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:48.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:48 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:48.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:48 smithi135 ceph-mon[24697]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:49.773 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 0 on host 'smithi071' 2024-09-17T00:53:50.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:53:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:50.425 DEBUG:teuthology.orchestra.run.smithi071:osd.0> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T00:53:50.428 INFO:tasks.cephadm:Deploying osd.1 on smithi071 with /dev/vg_nvme/lv_3... 2024-09-17T00:53:50.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi071 to 15040M 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:53:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:53:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi071 to 15040M 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:53:51.058 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi071 to 15040M 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.060 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:53:51.060 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:53:51.060 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.060 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[23769]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[23769]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[23769]: from='osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[23769]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[28615]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[28615]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:51.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[28615]: from='osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:53:51.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-mon[28615]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:53:51.916 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[31939]: 2024-09-17T00:53:51.845+0000 7fdc0cf4c700 -1 osd.0 0 waiting for initial osdmap 2024-09-17T00:53:51.916 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:53:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[31939]: 2024-09-17T00:53:51.847+0000 7fdc058df700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:53:52.200 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:51 smithi135 ceph-mon[24697]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T00:53:52.200 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:51 smithi135 ceph-mon[24697]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T00:53:52.200 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:51 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:52.200 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:51 smithi135 ceph-mon[24697]: from='osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:53:52.201 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:51 smithi135 ceph-mon[24697]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:53:52.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[23769]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:52.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[23769]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:53:52.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[23769]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T00:53:52.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:52.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:52.986 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[28615]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:52.986 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[28615]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:53:52.987 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[28615]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T00:53:52.987 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:52.987 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:52.990 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:53:53.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-09-17T00:53:53.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:52 smithi135 ceph-mon[24697]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:52 smithi135 ceph-mon[24697]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:53:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:52 smithi135 ceph-mon[24697]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T00:53:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[23769]: osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831] boot 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[23769]: osdmap e8: 1 total, 1 up, 1 in 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:53:54.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[28615]: osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831] boot 2024-09-17T00:53:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[28615]: osdmap e8: 1 total, 1 up, 1 in 2024-09-17T00:53:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:53 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:54.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:53 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:53:54.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:53 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:53:54.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:53 smithi135 ceph-mon[24697]: osd.0 [v2:172.21.15.71:6802/781779831,v1:172.21.15.71:6803/781779831] boot 2024-09-17T00:53:54.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:53 smithi135 ceph-mon[24697]: osdmap e8: 1 total, 1 up, 1 in 2024-09-17T00:53:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:53 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:53:55.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:54 smithi071 ceph-mon[23769]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:55.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:54 smithi071 ceph-mon[23769]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T00:53:55.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:54 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:53:55.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:54 smithi071 ceph-mon[28615]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:55.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:54 smithi071 ceph-mon[28615]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T00:53:55.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:54 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:53:55.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:54 smithi135 ceph-mon[24697]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:54 smithi135 ceph-mon[24697]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T00:53:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:54 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:53:56.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:55 smithi071 ceph-mon[28615]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:56.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:55 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:53:56.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:55 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:56.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:55 smithi071 ceph-mon[23769]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:56.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:55 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:53:56.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:55 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:56.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:55 smithi135 ceph-mon[24697]: from='client.24148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:56.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:55 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:53:56.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:55 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:57.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:56 smithi071 ceph-mon[28615]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:53:57.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:56 smithi071 ceph-mon[23769]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:53:57.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:56 smithi135 ceph-mon[24697]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:53:58.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:53:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:53:58.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2461318999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c73608df-2b7d-46de-bd3b-b7aa211724dd"}]: dispatch 2024-09-17T00:53:58.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2461318999' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c73608df-2b7d-46de-bd3b-b7aa211724dd"}]': finished 2024-09-17T00:53:58.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[23769]: osdmap e10: 2 total, 1 up, 2 in 2024-09-17T00:53:58.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2461318999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c73608df-2b7d-46de-bd3b-b7aa211724dd"}]: dispatch 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2461318999' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c73608df-2b7d-46de-bd3b-b7aa211724dd"}]': finished 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[28615]: osdmap e10: 2 total, 1 up, 2 in 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:58.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:57 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2461318999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c73608df-2b7d-46de-bd3b-b7aa211724dd"}]: dispatch 2024-09-17T00:53:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:57 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2461318999' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c73608df-2b7d-46de-bd3b-b7aa211724dd"}]': finished 2024-09-17T00:53:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:57 smithi135 ceph-mon[24697]: osdmap e10: 2 total, 1 up, 2 in 2024-09-17T00:53:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:53:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:53:59.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:58 smithi071 ceph-mon[28615]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:53:59.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:53:58 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/286905596' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:53:59.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:58 smithi071 ceph-mon[23769]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:53:59.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:53:58 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/286905596' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:53:59.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:58 smithi135 ceph-mon[24697]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:53:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:53:58 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/286905596' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:54:01.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:00 smithi071 ceph-mon[28615]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:01.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:00 smithi071 ceph-mon[23769]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:01.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:00 smithi135 ceph-mon[24697]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:03.129 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:02 smithi071 ceph-mon[23769]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:03.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:02 smithi071 ceph-mon[28615]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:03.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:02 smithi135 ceph-mon[24697]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:05.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:04 smithi071 ceph-mon[23769]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:05.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:04 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T00:54:05.140 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:04 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:05.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:04 smithi071 ceph-mon[28615]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:05.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:04 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T00:54:05.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:04 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:05.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:04 smithi135 ceph-mon[24697]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:05.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:04 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T00:54:05.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:04 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:05.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:05 smithi071 ceph-mon[23769]: Deploying daemon osd.1 on smithi071 2024-09-17T00:54:05.978 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:05 smithi071 ceph-mon[28615]: Deploying daemon osd.1 on smithi071 2024-09-17T00:54:06.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:05 smithi135 ceph-mon[24697]: Deploying daemon osd.1 on smithi071 2024-09-17T00:54:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:06 smithi071 ceph-mon[28615]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:07.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:06 smithi071 ceph-mon[23769]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:07.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:06 smithi135 ceph-mon[24697]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:09.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:08 smithi071 ceph-mon[23769]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:09.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:08 smithi071 ceph-mon[28615]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:09.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:08 smithi135 ceph-mon[24697]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:10.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:10 smithi135 ceph-mon[24697]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:10.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:10.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:10.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:10.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:10.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:10.627 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:54:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:54:10.627 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[23769]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[28615]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:10.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:10.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:11.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:11 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:11.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:11 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:11.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:11 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:11.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:11 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:11.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:11 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:11.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:11 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:11.947 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 1 on host 'smithi071' 2024-09-17T00:54:12.560 DEBUG:teuthology.orchestra.run.smithi071:osd.1> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T00:54:12.563 INFO:tasks.cephadm:Deploying osd.2 on smithi071 with /dev/vg_nvme/lv_2... 2024-09-17T00:54:12.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T00:54:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi071 to 7520M 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[23769]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi071 to 7520M 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:12 smithi071 ceph-mon[28615]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T00:54:13.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi071 to 7520M 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:12 smithi135 ceph-mon[24697]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[23769]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[23769]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[23769]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[28615]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[28615]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:14.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-mon[28615]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:14.038 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[34812]: 2024-09-17T00:54:13.989+0000 7f9cba0b4700 -1 osd.1 0 waiting for initial osdmap 2024-09-17T00:54:14.038 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[34812]: 2024-09-17T00:54:13.996+0000 7f9cb4a4b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:54:14.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:13 smithi135 ceph-mon[24697]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T00:54:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:13 smithi135 ceph-mon[24697]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T00:54:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:13 smithi135 ceph-mon[24697]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:15.170 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:15 smithi071 ceph-mon[28615]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:15.170 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:15 smithi071 ceph-mon[28615]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:54:15.170 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:15 smithi071 ceph-mon[28615]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T00:54:15.170 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:15 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:15.170 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:15 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:15.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:14 smithi071 ceph-mon[23769]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:15.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:14 smithi071 ceph-mon[23769]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:54:15.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:14 smithi071 ceph-mon[23769]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T00:54:15.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:14 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:15.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:14 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:54:15.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-09-17T00:54:15.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:14 smithi135 ceph-mon[24697]: pgmap v52: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:14 smithi135 ceph-mon[24697]: from='osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:54:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:14 smithi135 ceph-mon[24697]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T00:54:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:14 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:14 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:16.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[23769]: osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910] boot 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[23769]: osdmap e13: 2 total, 2 up, 2 in 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[28615]: osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910] boot 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[28615]: osdmap e13: 2 total, 2 up, 2 in 2024-09-17T00:54:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:16.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:16 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:54:16.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:16 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:54:16.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:16.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:16 smithi135 ceph-mon[24697]: osd.1 [v2:172.21.15.71:6810/2282566910,v1:172.21.15.71:6811/2282566910] boot 2024-09-17T00:54:16.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:16 smithi135 ceph-mon[24697]: osdmap e13: 2 total, 2 up, 2 in 2024-09-17T00:54:16.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:54:17.266 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:17 smithi071 ceph-mon[28615]: pgmap v55: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:17.266 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:17 smithi071 ceph-mon[28615]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T00:54:17.266 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:17 smithi071 ceph-mon[23769]: pgmap v55: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:17.266 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:17 smithi071 ceph-mon[23769]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T00:54:17.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:17 smithi135 ceph-mon[24697]: pgmap v55: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:54:17.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:17 smithi135 ceph-mon[24697]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T00:54:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:54:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:54:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:54:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:54:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:54:18.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:54:18.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:54:18.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:18.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:18.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:18.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:18.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:19.232 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[23769]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:54:19.232 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[23769]: pgmap v57: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:19.232 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi071 2024-09-17T00:54:19.232 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[23769]: pgmap v58: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:19.233 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[23769]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:54:19.233 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[28615]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:54:19.233 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[28615]: pgmap v57: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:19.233 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi071 2024-09-17T00:54:19.234 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[28615]: pgmap v58: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:19.234 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:19 smithi071 ceph-mon[28615]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:54:19.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:19 smithi135 ceph-mon[24697]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:54:19.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:19 smithi135 ceph-mon[24697]: pgmap v57: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:19.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:19 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi071 2024-09-17T00:54:19.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:19 smithi135 ceph-mon[24697]: pgmap v58: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:19.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:19 smithi135 ceph-mon[24697]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:54:20.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:54:20 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:54:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/631714846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]: dispatch 2024-09-17T00:54:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]: dispatch 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]': finished 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: osdmap e15: 3 total, 2 up, 3 in 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:21.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/631714846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]: dispatch 2024-09-17T00:54:21.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]: dispatch 2024-09-17T00:54:21.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]': finished 2024-09-17T00:54:21.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: osdmap e15: 3 total, 2 up, 3 in 2024-09-17T00:54:21.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/631714846' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]: dispatch 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]: dispatch 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b59c3a1c-d475-4e9c-9543-75634ad7452a"}]': finished 2024-09-17T00:54:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: osdmap e15: 3 total, 2 up, 3 in 2024-09-17T00:54:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:22.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[23769]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:22.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[23769]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:54:22.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[23769]: Cluster is now healthy 2024-09-17T00:54:22.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/342217983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:54:22.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[28615]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:22.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[28615]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:54:22.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[28615]: Cluster is now healthy 2024-09-17T00:54:22.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:22 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/342217983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:54:22.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:22 smithi135 ceph-mon[24697]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:22.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:22 smithi135 ceph-mon[24697]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:54:22.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:22 smithi135 ceph-mon[24697]: Cluster is now healthy 2024-09-17T00:54:22.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:22 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/342217983' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:54:24.358 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:24 smithi071 ceph-mon[23769]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:24.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:24 smithi071 ceph-mon[28615]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:24.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:24 smithi135 ceph-mon[24697]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:26.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:26 smithi071 ceph-mon[23769]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:26.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:26 smithi071 ceph-mon[28615]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:26.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:26 smithi135 ceph-mon[24697]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:28.324 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:28 smithi071 ceph-mon[23769]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:28.324 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T00:54:28.324 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:28.324 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:28 smithi071 ceph-mon[28615]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:28.324 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T00:54:28.324 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:28.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:28 smithi135 ceph-mon[24697]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:28.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T00:54:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:29.295 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:29 smithi071 ceph-mon[23769]: Deploying daemon osd.2 on smithi071 2024-09-17T00:54:29.295 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:29 smithi071 ceph-mon[28615]: Deploying daemon osd.2 on smithi071 2024-09-17T00:54:29.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:29 smithi135 ceph-mon[24697]: Deploying daemon osd.2 on smithi071 2024-09-17T00:54:30.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:30 smithi071 ceph-mon[23769]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:30.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:30 smithi071 ceph-mon[28615]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:30.308 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:30 smithi135 ceph-mon[24697]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:30.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:54:30 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:54:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:54:31.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[23769]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:31.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:31.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:31.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:54:31.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:54:31.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[28615]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:31.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:54:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:54:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:31 smithi135 ceph-mon[24697]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:54:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:54:34.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[23769]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:34.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:34.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[28615]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:34.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:34.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:33 smithi135 ceph-mon[24697]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:34.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:35.608 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 2 on host 'smithi071' 2024-09-17T00:54:36.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:36.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:36.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:36.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:36.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:36.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:36.331 DEBUG:teuthology.orchestra.run.smithi071:osd.2> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T00:54:36.333 INFO:tasks.cephadm:Deploying osd.3 on smithi071 with /dev/vg_nvme/lv_1... 2024-09-17T00:54:36.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-17T00:54:37.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:36 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi071 to 5013M 2024-09-17T00:54:37.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:36 smithi135 ceph-mon[24697]: from='osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:54:37.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:36 smithi135 ceph-mon[24697]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:54:37.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:36 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi071 to 5013M 2024-09-17T00:54:37.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:36 smithi071 ceph-mon[23769]: from='osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:54:37.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:36 smithi071 ceph-mon[23769]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:54:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:36 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi071 to 5013M 2024-09-17T00:54:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:36 smithi071 ceph-mon[28615]: from='osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:54:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:36 smithi071 ceph-mon[28615]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:54:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[23769]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[23769]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[23769]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[23769]: from='osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[23769]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[28615]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[28615]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[28615]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[28615]: from='osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:38.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-mon[28615]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:38.148 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[37728]: 2024-09-17T00:54:37.922+0000 7fe4f0f27700 -1 osd.2 0 waiting for initial osdmap 2024-09-17T00:54:38.148 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:37 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[37728]: 2024-09-17T00:54:37.926+0000 7fe4e88b8700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:54:38.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:37 smithi135 ceph-mon[24697]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:37 smithi135 ceph-mon[24697]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T00:54:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:37 smithi135 ceph-mon[24697]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T00:54:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:37 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:37 smithi135 ceph-mon[24697]: from='osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:37 smithi135 ceph-mon[24697]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:54:38.762 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:54:38.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-09-17T00:54:39.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[23769]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:54:39.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[23769]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T00:54:39.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:39.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[28615]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:54:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[28615]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T00:54:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:38 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:39.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:38 smithi135 ceph-mon[24697]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:54:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:38 smithi135 ceph-mon[24697]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T00:54:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:38 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:38 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:40.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:54:40.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:54:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261] boot 2024-09-17T00:54:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: osdmap e18: 3 total, 3 up, 3 in 2024-09-17T00:54:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:39 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261] boot 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: osdmap e18: 3 total, 3 up, 3 in 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:40.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: osd.2 [v2:172.21.15.71:6818/1537007261,v1:172.21.15.71:6819/1537007261] boot 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: osdmap e18: 3 total, 3 up, 3 in 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:54:40.331 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:39 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-17T00:54:40.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:54:40] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:54:41.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-17T00:54:41.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T00:54:41.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T00:54:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:40 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.395 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:40 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:41.775 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:54:41] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:54:42.051 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:54:41 smithi071 sudo[39052]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:54:42.051 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:54:41 smithi071 sudo[39052]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:42.051 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:54:41 smithi071 sudo[39052]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi071 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.052 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi071 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:54:42.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:42.054 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.054 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.054 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:42.054 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:42.054 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:42.054 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:41 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi071 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:41 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:42.327 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39059]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:54:42.327 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39059]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:42.327 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39059]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:42.585 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39088]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:54:42.586 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39088]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:42.586 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39088]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:42.847 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39113]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:54:42.847 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39113]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:42.847 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39095]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:54:42.848 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39095]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:42.848 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39095]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:43.146 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:42 smithi071 sudo[39113]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:43.146 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39117]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:54:43.146 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39117]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:43.146 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39117]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:43.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[23769]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:54:43.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[23769]: pgmap v78: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:43.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:43.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[23769]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:54:43.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[23769]: Cluster is now healthy 2024-09-17T00:54:43.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[23769]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T00:54:43.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[28615]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:54:43.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[28615]: pgmap v78: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:43.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:43.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[28615]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:54:43.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[28615]: Cluster is now healthy 2024-09-17T00:54:43.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:42 smithi071 ceph-mon[28615]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T00:54:43.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:42 smithi135 ceph-mon[24697]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:54:43.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:42 smithi135 ceph-mon[24697]: pgmap v78: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:43.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:42 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:43.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:42 smithi135 ceph-mon[24697]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:54:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:42 smithi135 ceph-mon[24697]: Cluster is now healthy 2024-09-17T00:54:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:42 smithi135 ceph-mon[24697]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T00:54:43.605 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39127]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:54:43.605 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39127]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:43.606 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39127]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:43.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39146]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:54:43.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39146]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:43.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39146]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:44.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39150]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:54:44.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39150]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:44.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:43 smithi071 sudo[39150]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:44.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 sudo[39159]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:54:44.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 sudo[39159]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:44.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 sudo[39159]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:44.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 sudo[27219]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:54:44.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 sudo[27219]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:44.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 sudo[27219]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:44 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:44.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 sudo[27222]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:54:44.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 sudo[27222]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T00:54:44.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 sudo[27222]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:54:44.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:44.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:44.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:44.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:44.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:44.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:44.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:44.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:44 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1736173416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]: dispatch 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]: dispatch 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]': finished 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: osdmap e22: 4 total, 3 up, 4 in 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/137152321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1736173416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]: dispatch 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]: dispatch 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]': finished 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: osdmap e22: 4 total, 3 up, 4 in 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:54:45.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:45 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/137152321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: mgrmap e15: y(active, since 2m), standbys: x 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1736173416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]: dispatch 2024-09-17T00:54:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]: dispatch 2024-09-17T00:54:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb98b99e-fb27-4981-ae13-14ab172eebf7"}]': finished 2024-09-17T00:54:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: osdmap e22: 4 total, 3 up, 4 in 2024-09-17T00:54:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:54:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:45 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/137152321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:54:46.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:46 smithi135 ceph-mon[24697]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:47.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:46 smithi071 ceph-mon[23769]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:47.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:46 smithi071 ceph-mon[28615]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 17 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:48.947 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:48 smithi071 ceph-mon[23769]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:48.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:48 smithi071 ceph-mon[28615]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:48.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:48 smithi135 ceph-mon[24697]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:50.700 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:54:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:54:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:54:50.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:50 smithi135 ceph-mon[24697]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:50.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:50.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:51.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:50 smithi071 ceph-mon[23769]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:51.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:51.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:51.016 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:50 smithi071 ceph-mon[28615]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:51.016 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:51.016 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:51.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T00:54:51.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:51 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:51 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T00:54:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:51 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:51.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:51 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T00:54:51.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:51 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:52.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:52 smithi135 ceph-mon[24697]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:52.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:52 smithi135 ceph-mon[24697]: Deploying daemon osd.3 on smithi071 2024-09-17T00:54:52.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:52 smithi071 ceph-mon[28615]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:52.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:52 smithi071 ceph-mon[28615]: Deploying daemon osd.3 on smithi071 2024-09-17T00:54:52.963 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:52 smithi071 ceph-mon[23769]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:52.963 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:52 smithi071 ceph-mon[23769]: Deploying daemon osd.3 on smithi071 2024-09-17T00:54:54.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:54 smithi135 ceph-mon[24697]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:54.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:54 smithi071 ceph-mon[23769]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:54.971 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:54 smithi071 ceph-mon[28615]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:56.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:56 smithi071 ceph-mon[23769]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:56.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:56 smithi071 ceph-mon[28615]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:57.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:56 smithi135 ceph-mon[24697]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:57.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:57.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:57.968 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:57 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:58.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:57 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:54:58.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:54:58 smithi071 ceph-mon[23769]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:58.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:54:58 smithi071 ceph-mon[28615]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:59.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:54:58 smithi135 ceph-mon[24697]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:54:59.882 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 3 on host 'smithi071' 2024-09-17T00:55:00.486 DEBUG:teuthology.orchestra.run.smithi071:osd.3> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T00:55:00.489 INFO:tasks.cephadm:Deploying osd.4 on smithi135 with /dev/vg_nvme/lv_4... 2024-09-17T00:55:00.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi071 to 3760M 2024-09-17T00:55:01.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi071 to 3760M 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi071 to 3760M 2024-09-17T00:55:01.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:55:01] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:01.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:01 smithi135 ceph-mon[24697]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T00:55:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:01 smithi135 ceph-mon[24697]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T00:55:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:01 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:01 smithi135 ceph-mon[24697]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:55:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:01 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:01 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:02.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[23769]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T00:55:02.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[23769]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T00:55:02.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:02.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[23769]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:55:02.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:02.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:02.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[28615]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T00:55:02.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[28615]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T00:55:02.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:02.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[28615]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T00:55:02.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:02.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:02.147 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[40713]: 2024-09-17T00:55:01.806+0000 7f7924c65700 -1 osd.3 0 waiting for initial osdmap 2024-09-17T00:55:02.147 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 00:55:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[40713]: 2024-09-17T00:55:01.812+0000 7f791fdfd700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:55:03.001 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:55:03.021 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-09-17T00:55:03.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi071 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[28615]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[28615]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[28615]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi071 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[23769]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:03.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[23769]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:55:03.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[23769]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T00:55:03.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:03.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:02 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:03.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:02 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi071 2024-09-17T00:55:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:02 smithi135 ceph-mon[24697]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:02 smithi135 ceph-mon[24697]: from='osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-17T00:55:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:02 smithi135 ceph-mon[24697]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T00:55:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:02 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:02 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:03.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:03 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:55:03.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:03 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:55:03.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:03 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:03 smithi135 ceph-mon[24697]: osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907] boot 2024-09-17T00:55:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:03 smithi135 ceph-mon[24697]: osdmap e25: 4 total, 4 up, 4 in 2024-09-17T00:55:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:03 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:04.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:55:04.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:55:04.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:04.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[23769]: osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907] boot 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[23769]: osdmap e25: 4 total, 4 up, 4 in 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[28615]: osd.3 [v2:172.21.15.71:6826/3600348907,v1:172.21.15.71:6827/3600348907] boot 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[28615]: osdmap e25: 4 total, 4 up, 4 in 2024-09-17T00:55:04.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:03 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:55:04.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:04 smithi071 ceph-mon[23769]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:04 smithi071 ceph-mon[23769]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T00:55:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:04 smithi071 ceph-mon[28615]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:04 smithi071 ceph-mon[28615]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T00:55:05.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:04 smithi135 ceph-mon[24697]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-09-17T00:55:05.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:04 smithi135 ceph-mon[24697]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T00:55:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[23769]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:06.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[28615]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:06.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:06.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:06.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:05 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:05 smithi135 ceph-mon[24697]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:05 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:05 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:05 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:07.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:06 smithi071 ceph-mon[23769]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:06 smithi071 ceph-mon[28615]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:07.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:06 smithi135 ceph-mon[24697]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/1687890888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]: dispatch 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]: dispatch 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]': finished 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[23769]: osdmap e27: 5 total, 4 up, 5 in 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/3234006170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/1687890888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]: dispatch 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]: dispatch 2024-09-17T00:55:08.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]': finished 2024-09-17T00:55:08.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[28615]: osdmap e27: 5 total, 4 up, 5 in 2024-09-17T00:55:08.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:08.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:07 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/3234006170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:08.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:07 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/1687890888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]: dispatch 2024-09-17T00:55:08.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:07 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]: dispatch 2024-09-17T00:55:08.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:07 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f"}]': finished 2024-09-17T00:55:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:07 smithi135 ceph-mon[24697]: osdmap e27: 5 total, 4 up, 5 in 2024-09-17T00:55:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:07 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:07 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/3234006170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:09.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:08 smithi071 ceph-mon[23769]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:09.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:08 smithi071 ceph-mon[28615]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:09.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:08 smithi135 ceph-mon[24697]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:10 smithi135 ceph-mon[24697]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:11.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:55:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:11.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:10 smithi071 ceph-mon[23769]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:11.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:11.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:11.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:10 smithi071 ceph-mon[28615]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:11.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:11.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:12.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:12 smithi135 ceph-mon[24697]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:12 smithi071 ceph-mon[23769]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:13.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:12 smithi071 ceph-mon[28615]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:14.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:14 smithi135 ceph-mon[24697]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:15.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:14 smithi071 ceph-mon[23769]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:15.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:14 smithi071 ceph-mon[28615]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:16.973 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:16 smithi135 ceph-mon[24697]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:16.973 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T00:55:16.973 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:16.973 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:16 smithi135 ceph-mon[24697]: Deploying daemon osd.4 on smithi135 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[23769]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[23769]: Deploying daemon osd.4 on smithi135 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[28615]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:16 smithi071 ceph-mon[28615]: Deploying daemon osd.4 on smithi135 2024-09-17T00:55:18.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:55:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:19.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:18 smithi135 ceph-mon[24697]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:19.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:19.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:18 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:19.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:18 smithi071 ceph-mon[23769]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:19.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:19.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:18 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:19.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:18 smithi071 ceph-mon[28615]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:19.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:19.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:18 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:21.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:20 smithi071 ceph-mon[23769]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:21.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:20 smithi071 ceph-mon[28615]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:21.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:20 smithi135 ceph-mon[24697]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:22.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:22.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:22.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:22.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:22.082 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:22.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:22.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:22.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:22.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:22.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:21 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:22.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:22.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:22.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:22.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:22.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:21 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:22.961 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:22 smithi071 ceph-mon[23769]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:22.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:22 smithi071 ceph-mon[28615]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:23.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:22 smithi135 ceph-mon[24697]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:23.654 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 4 on host 'smithi135' 2024-09-17T00:55:24.251 DEBUG:teuthology.orchestra.run.smithi135:osd.4> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T00:55:24.254 INFO:tasks.cephadm:Deploying osd.5 on smithi135 with /dev/vg_nvme/lv_3... 2024-09-17T00:55:24.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T00:55:24.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:24.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:24.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:24.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:24.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:24.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:24.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi135 to 4791M 2024-09-17T00:55:24.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:24.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:24.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:55:24.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:24 smithi135 ceph-mon[24697]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:55:25.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:25.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:25.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:25.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi135 to 4791M 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[28615]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:25.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi135 to 4791M 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:55:25.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:24 smithi071 ceph-mon[23769]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:55:25.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:25 smithi135 ceph-mon[24697]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T00:55:25.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:25 smithi135 ceph-mon[24697]: osdmap e28: 5 total, 4 up, 5 in 2024-09-17T00:55:25.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:25 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:25.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:25 smithi135 ceph-mon[24697]: from='osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:25.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:25 smithi135 ceph-mon[24697]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:25.967 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 00:55:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[29403]: 2024-09-17T00:55:25.964+0000 7f3a01127700 -1 osd.4 0 waiting for initial osdmap 2024-09-17T00:55:25.967 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 00:55:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[29403]: 2024-09-17T00:55:25.968+0000 7f39fc2bf700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:55:26.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[23769]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T00:55:26.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[23769]: osdmap e28: 5 total, 4 up, 5 in 2024-09-17T00:55:26.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:26.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[23769]: from='osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:26.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[23769]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:26.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[28615]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T00:55:26.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[28615]: osdmap e28: 5 total, 4 up, 5 in 2024-09-17T00:55:26.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:26.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[28615]: from='osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:26.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:25 smithi071 ceph-mon[28615]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:26.804 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:55:26.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-09-17T00:55:27.123 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:26 smithi135 ceph-mon[24697]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:27.123 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:26 smithi135 ceph-mon[24697]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:55:27.123 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:26 smithi135 ceph-mon[24697]: osdmap e29: 5 total, 4 up, 5 in 2024-09-17T00:55:27.123 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:26 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:27.124 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:26 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[23769]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[23769]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:55:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[23769]: osdmap e29: 5 total, 4 up, 5 in 2024-09-17T00:55:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:27.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:27.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[28615]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-09-17T00:55:27.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[28615]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:55:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[28615]: osdmap e29: 5 total, 4 up, 5 in 2024-09-17T00:55:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:26 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:28.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:27 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:55:28.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:27 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:55:28.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:27 smithi135 ceph-mon[24697]: osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041] boot 2024-09-17T00:55:28.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:27 smithi135 ceph-mon[24697]: osdmap e30: 5 total, 5 up, 5 in 2024-09-17T00:55:28.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:27 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:28.249 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:27 smithi135 ceph-mon[24697]: osdmap e31: 5 total, 5 up, 5 in 2024-09-17T00:55:28.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:55:28.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:55:28.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[23769]: osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041] boot 2024-09-17T00:55:28.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[23769]: osdmap e30: 5 total, 5 up, 5 in 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[23769]: osdmap e31: 5 total, 5 up, 5 in 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[28615]: osd.4 [v2:172.21.15.135:6800/2260751041,v1:172.21.15.135:6801/2260751041] boot 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[28615]: osdmap e30: 5 total, 5 up, 5 in 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:55:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:27 smithi071 ceph-mon[28615]: osdmap e31: 5 total, 5 up, 5 in 2024-09-17T00:55:29.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:28 smithi135 ceph-mon[24697]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:29.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:29.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:29.311 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:29.312 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:28 smithi135 ceph-mon[24697]: osdmap e32: 5 total, 5 up, 5 in 2024-09-17T00:55:29.326 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[28615]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:29.326 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:29.326 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:29.326 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:29.326 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[28615]: osdmap e32: 5 total, 5 up, 5 in 2024-09-17T00:55:29.326 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[23769]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:29.326 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:29.327 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:29.327 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:29.327 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:28 smithi071 ceph-mon[23769]: osdmap e32: 5 total, 5 up, 5 in 2024-09-17T00:55:30.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:29 smithi071 ceph-mon[23769]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:30.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:29 smithi071 ceph-mon[23769]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T00:55:30.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:29 smithi071 ceph-mon[28615]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:30.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:29 smithi071 ceph-mon[28615]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T00:55:30.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:29 smithi135 ceph-mon[24697]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:30.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:29 smithi135 ceph-mon[24697]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/4152228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]: dispatch 2024-09-17T00:55:31.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]: dispatch 2024-09-17T00:55:31.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]': finished 2024-09-17T00:55:31.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: osdmap e34: 6 total, 5 up, 6 in 2024-09-17T00:55:31.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:30 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:31.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:55:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/4152228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]: dispatch 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]: dispatch 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]': finished 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: osdmap e34: 6 total, 5 up, 6 in 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/4152228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]: dispatch 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]: dispatch 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd5b5284-b5db-4b6e-9401-13611a54aec0"}]': finished 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: osdmap e34: 6 total, 5 up, 6 in 2024-09-17T00:55:31.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:30 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:31.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:55:31] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi135 2024-09-17T00:55:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:55:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:55:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/1810971553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi135 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/1810971553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:32.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:32.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:32.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:32.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi135 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/1810971553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:33.042 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:32 smithi135 ceph-mon[24697]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-17T00:55:33.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:32 smithi071 ceph-mon[23769]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-17T00:55:33.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:32 smithi071 ceph-mon[28615]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-17T00:55:35.161 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:34 smithi135 ceph-mon[24697]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-17T00:55:35.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:34 smithi071 ceph-mon[23769]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-17T00:55:35.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:34 smithi071 ceph-mon[28615]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-17T00:55:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:37 smithi135 ceph-mon[24697]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-17T00:55:37.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:37 smithi071 ceph-mon[23769]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-17T00:55:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:37 smithi071 ceph-mon[28615]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-17T00:55:38.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:38 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:55:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:39.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:39 smithi135 ceph-mon[24697]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-17T00:55:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:39 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T00:55:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:39 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:39 smithi135 ceph-mon[24697]: Deploying daemon osd.5 on smithi135 2024-09-17T00:55:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:39 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:39 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[23769]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[23769]: Deploying daemon osd.5 on smithi135 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[28615]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-17T00:55:39.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T00:55:39.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:39.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[28615]: Deploying daemon osd.5 on smithi135 2024-09-17T00:55:39.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:39.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:39 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:41.316 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:41 smithi135 ceph-mon[24697]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-17T00:55:41.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:41 smithi071 ceph-mon[23769]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-17T00:55:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:41 smithi071 ceph-mon[28615]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-17T00:55:43.270 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:43 smithi135 ceph-mon[24697]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T00:55:43.270 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:43 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:43.270 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:43 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:43.270 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:43 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:43.270 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:43 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:43.270 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:43 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:43.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[23769]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T00:55:43.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:43.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:43.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:43.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:43.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:43.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[28615]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T00:55:43.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:43.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:43.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:43.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:43.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:43 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:45.283 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:45 smithi135 ceph-mon[24697]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:45.316 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 5 on host 'smithi135' 2024-09-17T00:55:45.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:45 smithi071 ceph-mon[23769]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:45.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:45 smithi071 ceph-mon[28615]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:45.925 DEBUG:teuthology.orchestra.run.smithi135:osd.5> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T00:55:45.928 INFO:tasks.cephadm:Deploying osd.6 on smithi135 with /dev/vg_nvme/lv_2... 2024-09-17T00:55:45.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T00:55:46.209 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 00:55:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[32280]: 2024-09-17T00:55:45.972+0000 7f16a5f163c0 -1 osd.5 0 log_to_monitors true 2024-09-17T00:55:46.515 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.515 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:46.515 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:46.515 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:46.515 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:46.515 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:46.515 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi135 to 2395M 2024-09-17T00:55:46.516 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.516 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.516 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:46.516 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:55:46.516 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:46 smithi135 ceph-mon[24697]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi135 to 2395M 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[23769]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi135 to 2395M 2024-09-17T00:55:46.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:46.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:46.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:55:46.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:46 smithi071 ceph-mon[28615]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:55:47.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:47 smithi135 ceph-mon[24697]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T00:55:47.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:47 smithi135 ceph-mon[24697]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T00:55:47.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:47 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:47.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:47 smithi135 ceph-mon[24697]: from='osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:47.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:47 smithi135 ceph-mon[24697]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:47.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 00:55:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[32280]: 2024-09-17T00:55:47.362+0000 7f169c919700 -1 osd.5 0 waiting for initial osdmap 2024-09-17T00:55:47.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 00:55:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[32280]: 2024-09-17T00:55:47.367+0000 7f1695aad700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:55:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[23769]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T00:55:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[23769]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T00:55:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[23769]: from='osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[23769]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:47.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[28615]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T00:55:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[28615]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T00:55:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[28615]: from='osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:47 smithi071 ceph-mon[28615]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:55:48.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:48 smithi135 ceph-mon[24697]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:55:48.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:48 smithi135 ceph-mon[24697]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T00:55:48.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:48 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:48.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:48 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:48.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:48 smithi135 ceph-mon[24697]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:48.470 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:55:48.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[23769]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[23769]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[23769]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[28615]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[28615]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T00:55:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:48.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:48.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:48 smithi071 ceph-mon[28615]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-09-17T00:55:49.554 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:49 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:55:49.555 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:49 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:55:49.555 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:49 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:49.555 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:49 smithi135 ceph-mon[24697]: osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427] boot 2024-09-17T00:55:49.555 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:49 smithi135 ceph-mon[24697]: osdmap e37: 6 total, 6 up, 6 in 2024-09-17T00:55:49.555 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:49 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:49.555 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:49 smithi135 ceph-mon[24697]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[23769]: osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427] boot 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[23769]: osdmap e37: 6 total, 6 up, 6 in 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[23769]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T00:55:49.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:55:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:55:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[28615]: osd.5 [v2:172.21.15.135:6808/2586464427,v1:172.21.15.135:6809/2586464427] boot 2024-09-17T00:55:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[28615]: osdmap e37: 6 total, 6 up, 6 in 2024-09-17T00:55:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:55:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:49 smithi071 ceph-mon[28615]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T00:55:50.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:50 smithi135 ceph-mon[24697]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:50 smithi135 ceph-mon[24697]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T00:55:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:50 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:50.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:50 smithi135 ceph-mon[24697]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T00:55:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[23769]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[23769]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T00:55:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[23769]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T00:55:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[28615]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[28615]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T00:55:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:50 smithi071 ceph-mon[28615]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T00:55:51.656 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:51 smithi135 ceph-mon[24697]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:51.657 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:51 smithi135 ceph-mon[24697]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T00:55:51.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:55:51] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:51.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:51 smithi071 ceph-mon[23769]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:51.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:51 smithi071 ceph-mon[23769]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T00:55:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:51 smithi071 ceph-mon[28615]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:51 smithi071 ceph-mon[28615]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T00:55:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T00:55:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi135 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/436163188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]: dispatch 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]: dispatch 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]': finished 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: osdmap e42: 7 total, 6 up, 7 in 2024-09-17T00:55:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:52 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:55:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T00:55:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi135 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/436163188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]: dispatch 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]: dispatch 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]': finished 2024-09-17T00:55:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: osdmap e42: 7 total, 6 up, 7 in 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi135 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:52.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:52.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/436163188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]: dispatch 2024-09-17T00:55:52.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]: dispatch 2024-09-17T00:55:52.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f9e5591-ed3e-4405-adf1-12634536cd5d"}]': finished 2024-09-17T00:55:52.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: osdmap e42: 7 total, 6 up, 7 in 2024-09-17T00:55:52.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:52 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:55:53.395 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:55:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:55:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/724820504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/724820504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:53 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:55:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/724820504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:53 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:54.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:54 smithi071 ceph-mon[23769]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:54.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:54 smithi071 ceph-mon[23769]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:55:54.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:54 smithi071 ceph-mon[28615]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:54.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:54 smithi071 ceph-mon[28615]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:55:54.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:54 smithi135 ceph-mon[24697]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:55:54.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:54 smithi135 ceph-mon[24697]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:55:55.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:55 smithi135 ceph-mon[24697]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T00:55:55.815 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:55 smithi135 ceph-mon[24697]: Cluster is now healthy 2024-09-17T00:55:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:55 smithi071 ceph-mon[23769]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T00:55:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:55 smithi071 ceph-mon[23769]: Cluster is now healthy 2024-09-17T00:55:55.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:55 smithi071 ceph-mon[28615]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T00:55:55.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:55 smithi071 ceph-mon[28615]: Cluster is now healthy 2024-09-17T00:55:56.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:56 smithi135 ceph-mon[24697]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-17T00:55:57.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:56 smithi071 ceph-mon[23769]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-17T00:55:57.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:56 smithi071 ceph-mon[28615]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-17T00:55:58.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:58 smithi071 ceph-mon[28615]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-17T00:55:58.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:58 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:58.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:55:58 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:58 smithi071 ceph-mon[23769]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-17T00:55:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:58 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:55:58 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:58.897 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:55:58 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:55:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:55:58.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:58 smithi135 ceph-mon[24697]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-17T00:55:58.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:58 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:55:58.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:55:58 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:00.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:00 smithi135 ceph-mon[24697]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-17T00:56:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T00:56:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:00 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:00 smithi135 ceph-mon[24697]: Deploying daemon osd.6 on smithi135 2024-09-17T00:56:01.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[28615]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-17T00:56:01.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T00:56:01.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:01.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[28615]: Deploying daemon osd.6 on smithi135 2024-09-17T00:56:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[23769]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-17T00:56:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T00:56:01.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:01.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:00 smithi071 ceph-mon[23769]: Deploying daemon osd.6 on smithi135 2024-09-17T00:56:02.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:02 smithi135 ceph-mon[24697]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-17T00:56:03.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:02 smithi071 ceph-mon[23769]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-17T00:56:03.124 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:02 smithi071 ceph-mon[28615]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-17T00:56:04.998 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:04 smithi135 ceph-mon[24697]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 47 KiB/s, 0 objects/s recovering 2024-09-17T00:56:04.999 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:04 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:04.999 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:04 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:04.999 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:04 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:04.999 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:04 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:04.999 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:04 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[28615]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 47 KiB/s, 0 objects/s recovering 2024-09-17T00:56:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[23769]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 47 KiB/s, 0 objects/s recovering 2024-09-17T00:56:05.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:05.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:05.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:05.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:05.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:04 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:07.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:06 smithi071 ceph-mon[23769]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 43 KiB/s, 0 objects/s recovering 2024-09-17T00:56:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:06 smithi071 ceph-mon[28615]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 43 KiB/s, 0 objects/s recovering 2024-09-17T00:56:07.160 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:06 smithi135 ceph-mon[24697]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 43 KiB/s, 0 objects/s recovering 2024-09-17T00:56:07.467 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 6 on host 'smithi135' 2024-09-17T00:56:08.072 DEBUG:teuthology.orchestra.run.smithi135:osd.6> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.6.service 2024-09-17T00:56:08.074 INFO:tasks.cephadm:Deploying osd.7 on smithi135 with /dev/vg_nvme/lv_1... 2024-09-17T00:56:08.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-17T00:56:08.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:08.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:08.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi135 to 1597M 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T00:56:08.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:08 smithi135 ceph-mon[24697]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T00:56:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi135 to 1597M 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[23769]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi135 to 1597M 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T00:56:08.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:08 smithi071 ceph-mon[28615]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T00:56:09.557 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:09 smithi135 ceph-mon[24697]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T00:56:09.557 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:09 smithi135 ceph-mon[24697]: osdmap e43: 7 total, 6 up, 7 in 2024-09-17T00:56:09.557 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:09 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:09.557 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:09 smithi135 ceph-mon[24697]: from='osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:09.557 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:09 smithi135 ceph-mon[24697]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:09.557 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 00:56:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[35176]: 2024-09-17T00:56:09.517+0000 7f911bb79700 -1 osd.6 0 waiting for initial osdmap 2024-09-17T00:56:09.557 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 00:56:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[35176]: 2024-09-17T00:56:09.524+0000 7f9117512700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[23769]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[23769]: osdmap e43: 7 total, 6 up, 7 in 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[23769]: from='osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[23769]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[28615]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[28615]: osdmap e43: 7 total, 6 up, 7 in 2024-09-17T00:56:09.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[28615]: from='osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:09 smithi071 ceph-mon[28615]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:10.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:10 smithi135 ceph-mon[24697]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:10.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:10 smithi135 ceph-mon[24697]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:56:10.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:10 smithi135 ceph-mon[24697]: osdmap e44: 7 total, 6 up, 7 in 2024-09-17T00:56:10.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:10.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:10 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:10.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-17T00:56:10.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-09-17T00:56:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[23769]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[23769]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:56:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[23769]: osdmap e44: 7 total, 6 up, 7 in 2024-09-17T00:56:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:10.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[28615]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:10.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[28615]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:56:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[28615]: osdmap e44: 7 total, 6 up, 7 in 2024-09-17T00:56:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:10 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:11 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:56:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:11 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:56:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:11 smithi135 ceph-mon[24697]: osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576] boot 2024-09-17T00:56:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:11 smithi135 ceph-mon[24697]: osdmap e45: 7 total, 7 up, 7 in 2024-09-17T00:56:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:11 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:56:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:56:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[23769]: osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576] boot 2024-09-17T00:56:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[23769]: osdmap e45: 7 total, 7 up, 7 in 2024-09-17T00:56:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:11.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:56:11.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:56:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[28615]: osd.6 [v2:172.21.15.135:6816/2277624576,v1:172.21.15.135:6817/2277624576] boot 2024-09-17T00:56:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[28615]: osdmap e45: 7 total, 7 up, 7 in 2024-09-17T00:56:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:11 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:12.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:12 smithi071 ceph-mon[23769]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:12.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:12 smithi071 ceph-mon[23769]: osdmap e46: 7 total, 7 up, 7 in 2024-09-17T00:56:12.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:12 smithi071 ceph-mon[28615]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:12.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:12 smithi071 ceph-mon[28615]: osdmap e46: 7 total, 7 up, 7 in 2024-09-17T00:56:12.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:12 smithi135 ceph-mon[24697]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-09-17T00:56:12.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:12 smithi135 ceph-mon[24697]: osdmap e46: 7 total, 7 up, 7 in 2024-09-17T00:56:13.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: osdmap e47: 7 total, 7 up, 7 in 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:13.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:13 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:56:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:56:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: osdmap e47: 7 total, 7 up, 7 in 2024-09-17T00:56:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:56:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: osdmap e47: 7 total, 7 up, 7 in 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:56:13.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:56:13.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:13.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:13.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:13.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:13.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:13.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:13 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:14.835 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:14 smithi135 ceph-mon[24697]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:14.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:14 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi135 2024-09-17T00:56:14.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:14 smithi135 ceph-mon[24697]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:14.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:14 smithi135 ceph-mon[24697]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:56:14.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:14 smithi135 ceph-mon[24697]: osdmap e48: 7 total, 7 up, 7 in 2024-09-17T00:56:14.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[23769]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:14.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi135 2024-09-17T00:56:14.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[23769]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:14.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[23769]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:56:14.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[23769]: osdmap e48: 7 total, 7 up, 7 in 2024-09-17T00:56:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[28615]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi135 2024-09-17T00:56:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[28615]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[28615]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:56:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:14 smithi071 ceph-mon[28615]: osdmap e48: 7 total, 7 up, 7 in 2024-09-17T00:56:15.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:15 smithi071 ceph-mon[23769]: osdmap e49: 7 total, 7 up, 7 in 2024-09-17T00:56:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:15 smithi071 ceph-mon[28615]: osdmap e49: 7 total, 7 up, 7 in 2024-09-17T00:56:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:15 smithi135 ceph-mon[24697]: osdmap e49: 7 total, 7 up, 7 in 2024-09-17T00:56:16.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/150921389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]: dispatch 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]: dispatch 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]': finished 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: osdmap e50: 8 total, 7 up, 8 in 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/1990559527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:16.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:16 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:56:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:56:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/150921389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]: dispatch 2024-09-17T00:56:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]: dispatch 2024-09-17T00:56:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]': finished 2024-09-17T00:56:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: osdmap e50: 8 total, 7 up, 8 in 2024-09-17T00:56:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/1990559527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/150921389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]: dispatch 2024-09-17T00:56:16.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]: dispatch 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cf11aaa-cd27-44c8-bd11-9b629c706c6a"}]': finished 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: osdmap e50: 8 total, 7 up, 8 in 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/1990559527' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:16.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:16 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:17 smithi071 ceph-mon[23769]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-17T00:56:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:17 smithi071 ceph-mon[23769]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:56:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:17 smithi071 ceph-mon[23769]: Cluster is now healthy 2024-09-17T00:56:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:17 smithi071 ceph-mon[28615]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-17T00:56:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:17 smithi071 ceph-mon[28615]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:56:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:17 smithi071 ceph-mon[28615]: Cluster is now healthy 2024-09-17T00:56:17.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:17 smithi135 ceph-mon[24697]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-17T00:56:17.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:17 smithi135 ceph-mon[24697]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:56:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:17 smithi135 ceph-mon[24697]: Cluster is now healthy 2024-09-17T00:56:19.030 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:56:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:56:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:19 smithi071 ceph-mon[23769]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-17T00:56:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:19 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:19 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:19 smithi071 ceph-mon[28615]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-17T00:56:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:19 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:19 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:19.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:19 smithi135 ceph-mon[24697]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-17T00:56:19.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:19 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:19 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:21.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:21 smithi135 ceph-mon[24697]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-17T00:56:21.895 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:21 smithi071 ceph-mon[28615]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-17T00:56:21.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:21 smithi071 ceph-mon[23769]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-17T00:56:23.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:23 smithi135 ceph-mon[24697]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-17T00:56:23.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:23 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T00:56:23.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:23 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:24.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:23 smithi071 ceph-mon[23769]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-17T00:56:24.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:23 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T00:56:24.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:23 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:24.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:23 smithi071 ceph-mon[28615]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-17T00:56:24.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:23 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T00:56:24.019 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:23 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:24.750 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:24 smithi135 ceph-mon[24697]: Deploying daemon osd.7 on smithi135 2024-09-17T00:56:24.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:24 smithi071 ceph-mon[28615]: Deploying daemon osd.7 on smithi135 2024-09-17T00:56:24.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:24 smithi071 ceph-mon[23769]: Deploying daemon osd.7 on smithi135 2024-09-17T00:56:25.781 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:25 smithi135 ceph-mon[24697]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-17T00:56:26.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:25 smithi071 ceph-mon[28615]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-17T00:56:26.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:25 smithi071 ceph-mon[23769]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-17T00:56:27.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:27 smithi135 ceph-mon[24697]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T00:56:28.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:27 smithi071 ceph-mon[23769]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T00:56:28.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:27 smithi071 ceph-mon[28615]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-17T00:56:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:28.749 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:28 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:29.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:29.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:29.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:28 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:29.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:29 smithi135 ceph-mon[24697]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:30.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:29 smithi071 ceph-mon[23769]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:30.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:29 smithi071 ceph-mon[28615]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:30.818 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 7 on host 'smithi135' 2024-09-17T00:56:31.431 DEBUG:teuthology.orchestra.run.smithi135:osd.7> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.7.service 2024-09-17T00:56:31.433 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-17T00:56:31.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T00:56:32.054 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: Adjusting osd_memory_target on smithi135 to 1197M 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[28615]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: Adjusting osd_memory_target on smithi135 to 1197M 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T00:56:32.057 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:31 smithi071 ceph-mon[23769]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T00:56:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: Adjusting osd_memory_target on smithi135 to 1197M 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T00:56:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:31 smithi135 ceph-mon[24697]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T00:56:32.934 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[23769]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[23769]: osdmap e51: 8 total, 7 up, 8 in 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[23769]: from='osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[23769]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[28615]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[28615]: osdmap e51: 8 total, 7 up, 8 in 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[28615]: from='osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:32.935 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:32 smithi071 ceph-mon[28615]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:33.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:32 smithi135 ceph-mon[24697]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T00:56:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:32 smithi135 ceph-mon[24697]: osdmap e51: 8 total, 7 up, 8 in 2024-09-17T00:56:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:32 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:32 smithi135 ceph-mon[24697]: from='osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:32 smithi135 ceph-mon[24697]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T00:56:33.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 00:56:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[38091]: 2024-09-17T00:56:32.883+0000 7fe577d8a700 -1 osd.7 0 waiting for initial osdmap 2024-09-17T00:56:33.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 00:56:32 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[38091]: 2024-09-17T00:56:32.891+0000 7fe572721700 -1 osd.7 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:56:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:56:33.863 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":52,"num_osds":8,"num_up_osds":7,"osd_up_since":1726534570,"num_in_osds":8,"osd_in_since":1726534575,"num_remapped_pgs":0} 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: osdmap e52: 8 total, 7 up, 8 in 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4228904455' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042] boot 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: osdmap e53: 8 total, 8 up, 8 in 2024-09-17T00:56:34.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: osdmap e52: 8 total, 7 up, 8 in 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4228904455' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042] boot 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: osdmap e53: 8 total, 8 up, 8 in 2024-09-17T00:56:34.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:33 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: osdmap e52: 8 total, 7 up, 8 in 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4228904455' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: osd.7 [v2:172.21.15.135:6824/2631825042,v1:172.21.15.135:6825/2631825042] boot 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: osdmap e53: 8 total, 8 up, 8 in 2024-09-17T00:56:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:33 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:34.864 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T00:56:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:34 smithi071 ceph-mon[23769]: purged_snaps scrub starts 2024-09-17T00:56:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:34 smithi071 ceph-mon[23769]: purged_snaps scrub ok 2024-09-17T00:56:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:34 smithi071 ceph-mon[23769]: osdmap e54: 8 total, 8 up, 8 in 2024-09-17T00:56:35.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:34 smithi071 ceph-mon[28615]: purged_snaps scrub starts 2024-09-17T00:56:35.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:34 smithi071 ceph-mon[28615]: purged_snaps scrub ok 2024-09-17T00:56:35.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:34 smithi071 ceph-mon[28615]: osdmap e54: 8 total, 8 up, 8 in 2024-09-17T00:56:35.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:34 smithi135 ceph-mon[24697]: purged_snaps scrub starts 2024-09-17T00:56:35.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:34 smithi135 ceph-mon[24697]: purged_snaps scrub ok 2024-09-17T00:56:35.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:34 smithi135 ceph-mon[24697]: osdmap e54: 8 total, 8 up, 8 in 2024-09-17T00:56:36.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:56:35] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:56:36.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[28615]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:36.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[28615]: osdmap e55: 8 total, 8 up, 8 in 2024-09-17T00:56:36.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:36.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:36.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[23769]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:36.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[23769]: osdmap e55: 8 total, 8 up, 8 in 2024-09-17T00:56:36.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:36.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:35 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:36.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:35 smithi135 ceph-mon[24697]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 46 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:36.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:35 smithi135 ceph-mon[24697]: osdmap e55: 8 total, 8 up, 8 in 2024-09-17T00:56:36.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:35 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:56:36.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:36 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi135 2024-09-17T00:56:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:36 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi135 2024-09-17T00:56:37.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:36 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi135 2024-09-17T00:56:37.589 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1726534593,"num_in_osds":8,"osd_in_since":1726534575,"num_remapped_pgs":0} 2024-09-17T00:56:37.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T00:56:37.799 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:56:38.074 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:37 smithi135 ceph-mon[24697]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:38.074 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:37 smithi135 ceph-mon[24697]: osdmap e56: 8 total, 8 up, 8 in 2024-09-17T00:56:38.074 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:37 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1638811065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:56:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:37 smithi071 ceph-mon[23769]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:37 smithi071 ceph-mon[23769]: osdmap e56: 8 total, 8 up, 8 in 2024-09-17T00:56:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:37 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1638811065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:56:38.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:37 smithi071 ceph-mon[28615]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:38.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:37 smithi071 ceph-mon[28615]: osdmap e56: 8 total, 8 up, 8 in 2024-09-17T00:56:38.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:37 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1638811065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:56:38.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:38 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:56:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:56:38.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:38 smithi135 ceph-mon[24697]: osdmap e57: 8 total, 8 up, 8 in 2024-09-17T00:56:38.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:38 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:38.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:38 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:39.184 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:38 smithi071 ceph-mon[23769]: osdmap e57: 8 total, 8 up, 8 in 2024-09-17T00:56:39.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:38 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:39.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:38 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:39.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:38 smithi071 ceph-mon[28615]: osdmap e57: 8 total, 8 up, 8 in 2024-09-17T00:56:39.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:38 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:39.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:38 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:39.568 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:56:39.568 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":57,"fsid":"e9235fcc-748e-11ef-bceb-c7b262605968","created":"2024-09-17T00:51:43.432593+0000","modified":"2024-09-17T00:56:37.893063+0000","last_up_change":"2024-09-17T00:56:33.633041+0000","last_in_change":"2024-09-17T00:56:15.698163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T00:54:39.469053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"986e6205-636b-423b-9047-d512ca0fc630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6803","nonce":781779831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6805","nonce":781779831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6809","nonce":781779831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6807","nonce":781779831}]},"public_addr":"172.21.15.71:6803/781779831","cluster_addr":"172.21.15.71:6805/781779831","heartbeat_back_addr":"172.21.15.71:6809/781779831","heartbeat_front_addr":"172.21.15.71:6807/781779831","state":["exists","up"]},{"osd":1,"uuid":"c73608df-2b7d-46de-bd3b-b7aa211724dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6811","nonce":2282566910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6813","nonce":2282566910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6817","nonce":2282566910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6815","nonce":2282566910}]},"public_addr":"172.21.15.71:6811/2282566910","cluster_addr":"172.21.15.71:6813/2282566910","heartbeat_back_addr":"172.21.15.71:6817/2282566910","heartbeat_front_addr":"172.21.15.71:6815/2282566910","state":["exists","up"]},{"osd":2,"uuid":"b59c3a1c-d475-4e9c-9543-75634ad7452a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6819","nonce":1537007261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6821","nonce":1537007261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6825","nonce":1537007261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6823","nonce":1537007261}]},"public_addr":"172.21.15.71:6819/1537007261","cluster_addr":"172.21.15.71:6821/1537007261","heartbeat_back_addr":"172.21.15.71:6825/1537007261","heartbeat_front_addr":"172.21.15.71:6823/1537007261","state":["exists","up"]},{"osd":3,"uuid":"eb98b99e-fb27-4981-ae13-14ab172eebf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6827","nonce":3600348907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6829","nonce":3600348907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6833","nonce":3600348907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6831","nonce":3600348907}]},"public_addr":"172.21.15.71:6827/3600348907","cluster_addr":"172.21.15.71:6829/3600348907","heartbeat_back_addr":"172.21.15.71:6833/3600348907","heartbeat_front_addr":"172.21.15.71:6831/3600348907","state":["exists","up"]},{"osd":4,"uuid":"df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6801","nonce":2260751041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6803","nonce":2260751041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6807","nonce":2260751041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6805","nonce":2260751041}]},"public_addr":"172.21.15.135:6801/2260751041","cluster_addr":"172.21.15.135:6803/2260751041","heartbeat_back_addr":"172.21.15.135:6807/2260751041","heartbeat_front_addr":"172.21.15.135:6805/2260751041","state":["exists","up"]},{"osd":5,"uuid":"dd5b5284-b5db-4b6e-9401-13611a54aec0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6809","nonce":2586464427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6811","nonce":2586464427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6815","nonce":2586464427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6813","nonce":2586464427}]},"public_addr":"172.21.15.135:6809/2586464427","cluster_addr":"172.21.15.135:6811/2586464427","heartbeat_back_addr":"172.21.15.135:6815/2586464427","heartbeat_front_addr":"172.21.15.135:6813/2586464427","state":["exists","up"]},{"osd":6,"uuid":"6f9e5591-ed3e-4405-adf1-12634536cd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6817","nonce":2277624576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6819","nonce":2277624576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6823","nonce":2277624576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6821","nonce":2277624576}]},"public_addr":"172.21.15.135:6817/2277624576","cluster_addr":"172.21.15.135:6819/2277624576","heartbeat_back_addr":"172.21.15.135:6823/2277624576","heartbeat_front_addr":"172.21.15.135:6821/2277624576","state":["exists","up"]},{"osd":7,"uuid":"3cf11aaa-cd27-44c8-bd11-9b629c706c6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6825","nonce":2631825042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6827","nonce":2631825042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6831","nonce":2631825042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6829","nonce":2631825042}]},"public_addr":"172.21.15.135:6825/2631825042","cluster_addr":"172.21.15.135:6827/2631825042","heartbeat_back_addr":"172.21.15.135:6831/2631825042","heartbeat_front_addr":"172.21.15.135:6829/2631825042","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:53:51.166646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:54:13.444327+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:54:36.976619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:00.820103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:25.017408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:46.995753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:08.686609+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:32.287531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:0/1610062920":"2024-09-18T00:52:31.106175+0000","172.21.15.71:6800/2786955802":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/645001224":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/994352927":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6801/2786955802":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/806906688":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6800/3513527777":"2024-09-18T00:52:08.742069+0000","172.21.15.71:0/3673565773":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/1684728898":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6801/3513527777":"2024-09-18T00:52:08.742069+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T00:56:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:39 smithi071 ceph-mon[23769]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:39 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2620977444' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:56:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:39 smithi071 ceph-mon[28615]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:39 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2620977444' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:56:40.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:39 smithi135 ceph-mon[24697]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:39 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2620977444' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:56:40.305 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T00:54:39.469053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-17T00:56:40.305 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T00:56:40.510 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:56:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:41 smithi135 ceph-mon[24697]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-17T00:56:42.253 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-09-17T00:56:42.253 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:41 smithi071 ceph-mon[23769]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-17T00:56:42.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:41 smithi071 ceph-mon[28615]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-17T00:56:42.846 INFO:tasks.cephadm:Adding prometheus.a on smithi135 2024-09-17T00:56:42.846 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch apply prometheus '1;smithi135=a' 2024-09-17T00:56:43.160 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:42 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/71972651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T00:56:43.201 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:42 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/71972651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T00:56:43.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:42 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/71972651' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T00:56:44.200 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:43 smithi135 ceph-mon[24697]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-17T00:56:44.207 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:43 smithi071 ceph-mon[28615]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-17T00:56:44.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:43 smithi071 ceph-mon[23769]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-17T00:56:44.779 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled prometheus update... 2024-09-17T00:56:45.394 DEBUG:teuthology.orchestra.run.smithi135:prometheus.a> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service 2024-09-17T00:56:45.397 INFO:tasks.cephadm:Adding node-exporter.a on smithi071 2024-09-17T00:56:45.397 INFO:tasks.cephadm:Adding node-exporter.b on smithi135 2024-09-17T00:56:45.397 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch apply node-exporter '2;smithi071=a;smithi135=b' 2024-09-17T00:56:45.981 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ignoring --setuser ceph since I am not root 2024-09-17T00:56:45.981 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ignoring --setgroup ceph since I am not root 2024-09-17T00:56:45.981 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mgr[26259]: -- 172.21.15.135:0/410610925 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653d3eaa340 con 0x5653d3e82c00 2024-09-17T00:56:45.981 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:45.983+0000 7ff220d0b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi135=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: Saving service prometheus spec with placement smithi135=a;count:1 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:45.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:45 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:46.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-17T00:56:46.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi135=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:46.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: Saving service prometheus spec with placement smithi135=a;count:1 2024-09-17T00:56:46.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:46.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setuser ceph since I am not root 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setgroup ceph since I am not root 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mgr[24000]: -- 172.21.15.71:0/2970405646 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dcab546340 con 0x55dcab51f000 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:45.992+0000 7f41fff37000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T00:56:46.068 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:46.069+0000 7f41fff37000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi135=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: Saving service prometheus spec with placement smithi135=a;count:1 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' 2024-09-17T00:56:46.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:45 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:46.240 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:46.068+0000 7ff220d0b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T00:56:46.240 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:46.242+0000 7ff220d0b000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T00:56:46.326 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:46.242+0000 7f41fff37000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T00:56:46.530 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:46.331+0000 7ff220d0b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T00:56:46.530 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:46.463+0000 7ff220d0b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:56:46.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:46.328+0000 7f41fff37000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T00:56:46.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:46.458+0000 7f41fff37000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:56:46.822 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:46.675+0000 7ff220d0b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T00:56:46.991 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-mon[23769]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:56:46.992 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-mon[23769]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-17T00:56:46.992 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:46.666+0000 7f41fff37000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T00:56:46.992 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-mon[28615]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:56:46.992 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-mon[28615]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-17T00:56:47.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:46 smithi135 ceph-mon[24697]: from='mgr.14152 172.21.15.71:0/412796552' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:56:47.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:46 smithi135 ceph-mon[24697]: mgrmap e16: y(active, since 4m), standbys: x 2024-09-17T00:56:47.085 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:47.016+0000 7ff220d0b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T00:56:47.242 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:46.994+0000 7f41fff37000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T00:56:47.242 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:47.081+0000 7f41fff37000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T00:56:47.242 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:47.244+0000 7f41fff37000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T00:56:47.459 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:47.107+0000 7ff220d0b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T00:56:47.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:47.277+0000 7ff220d0b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T00:56:48.547 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:48.288+0000 7f41fff37000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T00:56:48.547 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:48.377+0000 7f41fff37000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T00:56:48.709 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:48.340+0000 7ff220d0b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T00:56:48.709 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:48.429+0000 7ff220d0b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T00:56:49.557 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:49.274+0000 7f41fff37000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T00:56:49.629 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:49.320+0000 7ff220d0b000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T00:56:49.814 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:49.583+0000 7f41fff37000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T00:56:49.815 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:49.722+0000 7f41fff37000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:56:49.946 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:49.631+0000 7ff220d0b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T00:56:49.946 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:49.763+0000 7ff220d0b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T00:56:49.946 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:49.850+0000 7ff220d0b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T00:56:50.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:49.816+0000 7f41fff37000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T00:56:50.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:49.920+0000 7f41fff37000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T00:56:50.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:50.014+0000 7f41fff37000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T00:56:50.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:49.948+0000 7ff220d0b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T00:56:50.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:50.035+0000 7ff220d0b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T00:56:50.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:50.182+0000 7ff220d0b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T00:56:50.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:50.169+0000 7f41fff37000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T00:56:50.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:50.267+0000 7f41fff37000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T00:56:50.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:50.366+0000 7f41fff37000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T00:56:50.658 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:50.275+0000 7ff220d0b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T00:56:50.658 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:50.370+0000 7ff220d0b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T00:56:50.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:50.660+0000 7ff220d0b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T00:56:50.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:50.748+0000 7ff220d0b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T00:56:50.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:50.836+0000 7ff220d0b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T00:56:51.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:50.659+0000 7f41fff37000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T00:56:51.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:50.752+0000 7f41fff37000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T00:56:51.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:50.842+0000 7f41fff37000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T00:56:52.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: Active manager daemon y restarted 2024-09-17T00:56:52.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: Activating manager daemon y 2024-09-17T00:56:52.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: osdmap e58: 8 total, 8 up, 8 in 2024-09-17T00:56:52.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: Standby manager daemon x restarted 2024-09-17T00:56:52.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: Standby manager daemon x started 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: Active manager daemon y restarted 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: Activating manager daemon y 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: osdmap e58: 8 total, 8 up, 8 in 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: Standby manager daemon x restarted 2024-09-17T00:56:52.180 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: Standby manager daemon x started 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:51.908+0000 7f41fff37000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:56:52] ENGINE Bus STARTING 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: CherryPy Checker: 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: The Application mounted at '' has an empty config. 2024-09-17T00:56:52.181 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T00:56:52.182 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:56:52] ENGINE Serving on http://:::9283 2024-09-17T00:56:52.182 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:56:52] ENGINE Bus STARTED 2024-09-17T00:56:52.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:51.921+0000 7ff220d0b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T00:56:52.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: [17/Sep/2024:00:56:51] ENGINE Bus STARTING 2024-09-17T00:56:52.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: CherryPy Checker: 2024-09-17T00:56:52.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: The Application mounted at '' has an empty config. 2024-09-17T00:56:52.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: 2024-09-17T00:56:52.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: [17/Sep/2024:00:56:52] ENGINE Serving on http://:::9283 2024-09-17T00:56:52.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: [17/Sep/2024:00:56:52] ENGINE Bus STARTED 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: Active manager daemon y restarted 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: Activating manager daemon y 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: osdmap e58: 8 total, 8 up, 8 in 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: Standby manager daemon x restarted 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: Standby manager daemon x started 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T00:56:52.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T00:56:52.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/3705209025' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T00:56:52.781 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:56:52] ENGINE Bus STARTING 2024-09-17T00:56:52.997 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled node-exporter update... 2024-09-17T00:56:53.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:56:52] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:56:53.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:00:56:52] ENGINE Bus STARTED 2024-09-17T00:56:53.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: mgrmap e17: y(active, starting, since 0.0579941s), standbys: x 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: Manager daemon y is now available 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: mgrmap e17: y(active, starting, since 0.0579941s), standbys: x 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:56:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: Manager daemon y is now available 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]': finished 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:53.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: [17/Sep/2024:00:56:52] ENGINE Bus STARTING 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: [17/Sep/2024:00:56:52] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: [17/Sep/2024:00:56:52] ENGINE Bus STARTED 2024-09-17T00:56:53.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]': finished 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:56:53.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: [17/Sep/2024:00:56:52] ENGINE Bus STARTING 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: [17/Sep/2024:00:56:52] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: [17/Sep/2024:00:56:52] ENGINE Bus STARTED 2024-09-17T00:56:53.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: mgrmap e17: y(active, starting, since 0.0579941s), standbys: x 2024-09-17T00:56:53.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T00:56:53.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T00:56:53.382 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:56:53.383 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: Manager daemon y is now available 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]': finished 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T00:56:53.384 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: [17/Sep/2024:00:56:52] ENGINE Bus STARTING 2024-09-17T00:56:53.385 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: [17/Sep/2024:00:56:52] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T00:56:53.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: [17/Sep/2024:00:56:52] ENGINE Bus STARTED 2024-09-17T00:56:53.386 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:53.698 DEBUG:teuthology.orchestra.run.smithi071:node-exporter.a> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.a.service 2024-09-17T00:56:53.701 DEBUG:teuthology.orchestra.run.smithi135:node-exporter.b> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.b.service 2024-09-17T00:56:53.703 INFO:tasks.cephadm:Adding alertmanager.a on smithi071 2024-09-17T00:56:53.704 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch apply alertmanager '1;smithi071=a' 2024-09-17T00:56:54.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:56:54.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:53 smithi135 ceph-mon[24697]: mgrmap e18: y(active, since 1.07344s), standbys: x 2024-09-17T00:56:54.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:53 smithi135 ceph-mon[24697]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi071=a;smithi135=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:54.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:53 smithi135 ceph-mon[24697]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:54.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:53 smithi135 ceph-mon[24697]: Saving service node-exporter spec with placement smithi071=a;smithi135=b;count:2 2024-09-17T00:56:54.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:54.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:53 smithi135 ceph-mon[24697]: Deploying daemon prometheus.a on smithi135 2024-09-17T00:56:54.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:56:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:56:54.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:56:54.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[23769]: mgrmap e18: y(active, since 1.07344s), standbys: x 2024-09-17T00:56:54.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[23769]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi071=a;smithi135=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:54.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[23769]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:54.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[23769]: Saving service node-exporter spec with placement smithi071=a;smithi135=b;count:2 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[23769]: Deploying daemon prometheus.a on smithi135 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[28615]: mgrmap e18: y(active, since 1.07344s), standbys: x 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[28615]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi071=a;smithi135=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[28615]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[28615]: Saving service node-exporter spec with placement smithi071=a;smithi135=b;count:2 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:54.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:53 smithi071 ceph-mon[28615]: Deploying daemon prometheus.a on smithi135 2024-09-17T00:56:55.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:54 smithi135 ceph-mon[24697]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:54 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:54 smithi135 ceph-mon[24697]: Detected new or changed devices on smithi135 2024-09-17T00:56:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:54 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:54 smithi135 ceph-mon[24697]: mgrmap e19: y(active, since 2s), standbys: x 2024-09-17T00:56:55.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[28615]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:55.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:55.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[28615]: Detected new or changed devices on smithi135 2024-09-17T00:56:55.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:55.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[28615]: mgrmap e19: y(active, since 2s), standbys: x 2024-09-17T00:56:55.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[23769]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[23769]: Detected new or changed devices on smithi135 2024-09-17T00:56:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:54 smithi071 ceph-mon[23769]: mgrmap e19: y(active, since 2s), standbys: x 2024-09-17T00:56:57.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:56 smithi135 ceph-mon[24697]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:57.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:56 smithi071 ceph-mon[23769]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:57.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:56 smithi071 ceph-mon[28615]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:57.988 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled alertmanager update... 2024-09-17T00:56:59.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:56:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:56:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[23769]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[23769]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi071=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[23769]: Saving service alertmanager spec with placement smithi071=a;count:1 2024-09-17T00:56:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[28615]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[28615]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi071=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[28615]: Saving service alertmanager spec with placement smithi071=a;count:1 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:56:58 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:58 smithi135 ceph-mon[24697]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:56:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:58 smithi135 ceph-mon[24697]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi071=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:58 smithi135 ceph-mon[24697]: Saving service alertmanager spec with placement smithi071=a;count:1 2024-09-17T00:56:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:58 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:58 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:56:58 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:56:59.747 DEBUG:teuthology.orchestra.run.smithi071:alertmanager.a> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@alertmanager.a.service 2024-09-17T00:56:59.750 INFO:tasks.cephadm:Adding grafana.a on smithi135 2024-09-17T00:56:59.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph orch apply grafana '1;smithi135=a' 2024-09-17T00:57:01.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:00 smithi071 ceph-mon[23769]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:01.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:00 smithi071 ceph-mon[28615]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:01.365 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:00 smithi135 ceph-mon[24697]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:03.326 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:02 smithi135 ceph-mon[24697]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:03.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:02 smithi071 ceph-mon[23769]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:03.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:02 smithi071 ceph-mon[28615]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:05.253 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled grafana update... 2024-09-17T00:57:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:05 smithi071 ceph-mon[23769]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:05 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:05.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:05 smithi071 ceph-mon[28615]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:05 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:05.929 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:05 smithi135 ceph-mon[24697]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:05.929 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:05 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:06.306 DEBUG:teuthology.orchestra.run.smithi135:grafana.a> sudo journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@grafana.a.service 2024-09-17T00:57:06.308 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T00:57:06.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T00:57:06.576 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 podman[40727]: 2024-09-17 00:57:06.427618601 +0000 UTC m=+0.016447757 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-09-17T00:57:06.576 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 podman[40727]: 2024-09-17 00:57:06.579173602 +0000 UTC m=+0.168002752 container create d15ae95e597f4f2a00d25995dfc73491933ce9f5bae24a0ab789f6ff84654b0f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:06.838 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-mon[24697]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi135=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:57:06.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-mon[24697]: Saving service grafana spec with placement smithi135=a;count:1 2024-09-17T00:57:06.839 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 podman[40727]: 2024-09-17 00:57:06.815480872 +0000 UTC m=+0.404310037 container init d15ae95e597f4f2a00d25995dfc73491933ce9f5bae24a0ab789f6ff84654b0f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:06.839 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 podman[40727]: 2024-09-17 00:57:06.818140268 +0000 UTC m=+0.406969428 container start d15ae95e597f4f2a00d25995dfc73491933ce9f5bae24a0ab789f6ff84654b0f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:06 smithi071 ceph-mon[23769]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi135=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:57:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:06 smithi071 ceph-mon[23769]: Saving service grafana spec with placement smithi135=a;count:1 2024-09-17T00:57:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:06 smithi071 ceph-mon[28615]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi135=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:57:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:06 smithi071 ceph-mon[28615]: Saving service grafana spec with placement smithi135=a;count:1 2024-09-17T00:57:07.120 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.841Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-09-17T00:57:07.120 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.841Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-09-17T00:57:07.120 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.841Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-09-17T00:57:07.120 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.841Z caller=main.go:518 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi135 (none))" 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.841Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.841Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.842Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.843Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.844Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.846Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.846Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.171µs 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.846Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.847Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-17T00:57:07.121 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.847Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.007µs wal_replay_duration=154.253µs total_replay_duration=189.48µs 2024-09-17T00:57:07.122 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.847Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T00:57:07.122 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.847Z caller=main.go:947 level=info msg="TSDB started" 2024-09-17T00:57:07.122 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.847Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T00:57:07.122 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.861Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.09671ms db_storage=736ns remote_storage=1.091µs web_handler=478ns query_engine=596ns scrape=358.181µs scrape_sd=17.021µs notify=979ns notify_sd=2.015µs rules=13.375724ms 2024-09-17T00:57:07.122 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:57:06.861Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-09-17T00:57:07.122 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 bash[40727]: d15ae95e597f4f2a00d25995dfc73491933ce9f5bae24a0ab789f6ff84654b0f 2024-09-17T00:57:07.122 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:57:06 smithi135 systemd[1]: Started Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:57:07.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:07.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.135:9095"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.733 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:07.733 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.733 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.733 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.733 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.135:9095"}]: dispatch 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.735 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.135:9095"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:07.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:08.191 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-09-17T00:57:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDk0+hmAl1oCxAAPYY+8zeD4I+s3XEqkoEEKQ== 2024-09-17T00:57:08.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.135:9095"}]: dispatch 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4000426822' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.135:9095"}]: dispatch 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.790 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4000426822' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:08.790 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:08.790 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:08 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:57:08.811 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-17T00:57:08.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T00:57:08.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T00:57:08.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T00:57:08.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:57:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.135:9095"}]: dispatch 2024-09-17T00:57:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4000426822' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:08 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:57:09.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:09 smithi135 ceph-mon[24697]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:10.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:09 smithi071 ceph-mon[23769]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:10.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:09 smithi071 ceph-mon[28615]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:11.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:11 smithi135 ceph-mon[24697]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:12.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:11 smithi071 ceph-mon[23769]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:12.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:11 smithi071 ceph-mon[28615]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:13 smithi071 ceph-mon[28615]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:13 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:13 smithi071 ceph-mon[23769]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:13 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:13.897 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:57:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:13.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:13 smithi135 ceph-mon[24697]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:13 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:14.889 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2024-09-17T00:57:14.889 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDq0+hmMb3RNBAAXArtcJLt7agk0jwShXqgLA== 2024-09-17T00:57:15.334 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:57:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:15.525 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-17T00:57:15.525 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T00:57:15.525 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T00:57:15.564 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T00:57:15.565 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T00:57:15.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T00:57:15.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:15.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='client.? 172.21.15.135:0/795182542' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:15.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='client.? 172.21.15.135:0/795182542' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:15.855 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:57:15.856 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.856 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.856 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:15.856 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:15.856 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:15.856 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.856 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:15 smithi071 systemd[1]: Starting Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:57:15.903 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:15.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:15.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='client.? 172.21.15.135:0/795182542' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:16.127 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:15 smithi071 bash[44417]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-09-17T00:57:16.395 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:16 smithi071 bash[44417]: Getting image source signatures 2024-09-17T00:57:16.396 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:16 smithi071 bash[44417]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-09-17T00:57:16.396 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:16 smithi071 bash[44417]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-09-17T00:57:16.396 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:16 smithi071 bash[44417]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-09-17T00:57:16.913 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:16 smithi071 ceph-mon[23769]: Deploying daemon node-exporter.a on smithi071 2024-09-17T00:57:16.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:16 smithi071 ceph-mon[28615]: Deploying daemon node-exporter.a on smithi071 2024-09-17T00:57:16.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:16 smithi135 ceph-mon[24697]: Deploying daemon node-exporter.a on smithi071 2024-09-17T00:57:17.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:17 smithi135 ceph-mon[24697]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:17.995 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:17 smithi071 ceph-mon[23769]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:17.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:17 smithi071 ceph-mon[28615]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:18.256 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:57:18.531 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:18 smithi071 bash[44417]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-09-17T00:57:18.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:18 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3439730267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T00:57:18.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:18 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3439730267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T00:57:18.896 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:18 smithi071 bash[44417]: Writing manifest to image destination 2024-09-17T00:57:18.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:18 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3439730267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T00:57:19.373 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:57:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:19.373 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 podman[44417]: 2024-09-17 00:57:18.975634573 +0000 UTC m=+3.150511029 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-09-17T00:57:19.373 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 podman[44417]: 2024-09-17 00:57:19.134283029 +0000 UTC m=+3.309159464 container create 41791b2fd73e0d6031685f40116c6b171fe525360edb8336147396383e56ff50 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:19.566 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 podman[44417]: 2024-09-17 00:57:19.483545408 +0000 UTC m=+3.658421851 container init 41791b2fd73e0d6031685f40116c6b171fe525360edb8336147396383e56ff50 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 podman[44417]: 2024-09-17 00:57:19.486718789 +0000 UTC m=+3.661595233 container start 41791b2fd73e0d6031685f40116c6b171fe525360edb8336147396383e56ff50 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.489Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.489Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.490Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.490Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.490Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.490Z caller=node_exporter.go:115 level=info collector=arp 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.490Z caller=node_exporter.go:115 level=info collector=bcache 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=bonding 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=btrfs 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=conntrack 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=cpu 2024-09-17T00:57:19.567 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-09-17T00:57:19.568 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=diskstats 2024-09-17T00:57:19.568 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=dmi 2024-09-17T00:57:19.568 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=edac 2024-09-17T00:57:19.568 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=entropy 2024-09-17T00:57:19.568 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-09-17T00:57:19.568 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=filefd 2024-09-17T00:57:19.568 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=filesystem 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=hwmon 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=infiniband 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=ipvs 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=loadavg 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=mdadm 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=meminfo 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=netclass 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=netdev 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=netstat 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=nfs 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=nfsd 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=nvme 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=os 2024-09-17T00:57:19.569 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=pressure 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=rapl 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=schedstat 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=sockstat 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=softnet 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=stat 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=tapestats 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=textfile 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=time 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=uname 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=vmstat 2024-09-17T00:57:19.570 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=xfs 2024-09-17T00:57:19.571 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:115 level=info collector=zfs 2024-09-17T00:57:19.571 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-09-17T00:57:19.571 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[44774]: ts=2024-09-17T00:57:19.491Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-09-17T00:57:19.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-mon[28615]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:19.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:19.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:19.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-mon[23769]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:19.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:19.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:19 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:19.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:19 smithi135 ceph-mon[24697]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:19.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:19 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:19 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:20.146 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 bash[44417]: 41791b2fd73e0d6031685f40116c6b171fe525360edb8336147396383e56ff50 2024-09-17T00:57:20.146 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 00:57:19 smithi071 systemd[1]: Started Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:57:20.359 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"active_gid":14439,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1025130945},{"type":"v1","addr":"172.21.15.71:6801","nonce":1025130945}]},"active_addr":"172.21.15.71:6801/1025130945","active_change":"2024-09-17T00:56:51.911297+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24341,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.71:8443/","prometheus":"http://172.21.15.71:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":58,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1416703784}]},{"addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1344998348}]},{"addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1442564666}]},{"addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3095327246}]}]}} 2024-09-17T00:57:20.362 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T00:57:20.363 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T00:57:20.363 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T00:57:20.592 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:20.799 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:20 smithi135 systemd[1]: Starting Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:57:21.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:20 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:20 smithi135 ceph-mon[24697]: Deploying daemon node-exporter.b on smithi135 2024-09-17T00:57:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:20 smithi135 ceph-mon[24697]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:21.210 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:20 smithi135 bash[41683]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-09-17T00:57:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:20 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:20 smithi071 ceph-mon[28615]: Deploying daemon node-exporter.b on smithi135 2024-09-17T00:57:21.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:20 smithi071 ceph-mon[28615]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:21.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:20 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:21.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:20 smithi071 ceph-mon[23769]: Deploying daemon node-exporter.b on smithi135 2024-09-17T00:57:21.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:20 smithi071 ceph-mon[23769]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:21.709 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:21 smithi135 bash[41683]: Getting image source signatures 2024-09-17T00:57:21.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:21 smithi135 bash[41683]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-09-17T00:57:21.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:21 smithi135 bash[41683]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-09-17T00:57:21.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:21 smithi135 bash[41683]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-09-17T00:57:22.453 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:57:22.454 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"fsid":"e9235fcc-748e-11ef-bceb-c7b262605968","created":"2024-09-17T00:51:43.432593+0000","modified":"2024-09-17T00:56:51.910976+0000","last_up_change":"2024-09-17T00:56:33.633041+0000","last_in_change":"2024-09-17T00:56:15.698163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T00:54:39.469053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"986e6205-636b-423b-9047-d512ca0fc630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6803","nonce":781779831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6805","nonce":781779831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6809","nonce":781779831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6807","nonce":781779831}]},"public_addr":"172.21.15.71:6803/781779831","cluster_addr":"172.21.15.71:6805/781779831","heartbeat_back_addr":"172.21.15.71:6809/781779831","heartbeat_front_addr":"172.21.15.71:6807/781779831","state":["exists","up"]},{"osd":1,"uuid":"c73608df-2b7d-46de-bd3b-b7aa211724dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6811","nonce":2282566910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6813","nonce":2282566910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6817","nonce":2282566910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6815","nonce":2282566910}]},"public_addr":"172.21.15.71:6811/2282566910","cluster_addr":"172.21.15.71:6813/2282566910","heartbeat_back_addr":"172.21.15.71:6817/2282566910","heartbeat_front_addr":"172.21.15.71:6815/2282566910","state":["exists","up"]},{"osd":2,"uuid":"b59c3a1c-d475-4e9c-9543-75634ad7452a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6819","nonce":1537007261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6821","nonce":1537007261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6825","nonce":1537007261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6823","nonce":1537007261}]},"public_addr":"172.21.15.71:6819/1537007261","cluster_addr":"172.21.15.71:6821/1537007261","heartbeat_back_addr":"172.21.15.71:6825/1537007261","heartbeat_front_addr":"172.21.15.71:6823/1537007261","state":["exists","up"]},{"osd":3,"uuid":"eb98b99e-fb27-4981-ae13-14ab172eebf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6827","nonce":3600348907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6829","nonce":3600348907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6833","nonce":3600348907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6831","nonce":3600348907}]},"public_addr":"172.21.15.71:6827/3600348907","cluster_addr":"172.21.15.71:6829/3600348907","heartbeat_back_addr":"172.21.15.71:6833/3600348907","heartbeat_front_addr":"172.21.15.71:6831/3600348907","state":["exists","up"]},{"osd":4,"uuid":"df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6801","nonce":2260751041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6803","nonce":2260751041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6807","nonce":2260751041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6805","nonce":2260751041}]},"public_addr":"172.21.15.135:6801/2260751041","cluster_addr":"172.21.15.135:6803/2260751041","heartbeat_back_addr":"172.21.15.135:6807/2260751041","heartbeat_front_addr":"172.21.15.135:6805/2260751041","state":["exists","up"]},{"osd":5,"uuid":"dd5b5284-b5db-4b6e-9401-13611a54aec0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6809","nonce":2586464427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6811","nonce":2586464427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6815","nonce":2586464427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6813","nonce":2586464427}]},"public_addr":"172.21.15.135:6809/2586464427","cluster_addr":"172.21.15.135:6811/2586464427","heartbeat_back_addr":"172.21.15.135:6815/2586464427","heartbeat_front_addr":"172.21.15.135:6813/2586464427","state":["exists","up"]},{"osd":6,"uuid":"6f9e5591-ed3e-4405-adf1-12634536cd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6817","nonce":2277624576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6819","nonce":2277624576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6823","nonce":2277624576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6821","nonce":2277624576}]},"public_addr":"172.21.15.135:6817/2277624576","cluster_addr":"172.21.15.135:6819/2277624576","heartbeat_back_addr":"172.21.15.135:6823/2277624576","heartbeat_front_addr":"172.21.15.135:6821/2277624576","state":["exists","up"]},{"osd":7,"uuid":"3cf11aaa-cd27-44c8-bd11-9b629c706c6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6825","nonce":2631825042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6827","nonce":2631825042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6831","nonce":2631825042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6829","nonce":2631825042}]},"public_addr":"172.21.15.135:6825/2631825042","cluster_addr":"172.21.15.135:6827/2631825042","heartbeat_back_addr":"172.21.15.135:6831/2631825042","heartbeat_front_addr":"172.21.15.135:6829/2631825042","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:53:51.166646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:54:13.444327+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:54:36.976619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:00.820103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:25.017408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:46.995753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:08.686609+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:32.287531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6801/3941349606":"2024-09-18T00:56:51.910944+0000","172.21.15.71:6800/3941349606":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/3623700348":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/653059959":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/1610062920":"2024-09-18T00:52:31.106175+0000","172.21.15.71:6800/2786955802":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/3232619979":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/645001224":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/372115331":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/994352927":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6801/2786955802":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/806906688":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6800/3513527777":"2024-09-18T00:52:08.742069+0000","172.21.15.71:0/3673565773":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/1684728898":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6801/3513527777":"2024-09-18T00:52:08.742069+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T00:57:23.028 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:22 smithi135 bash[41683]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-09-17T00:57:23.028 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:22 smithi135 bash[41683]: Writing manifest to image destination 2024-09-17T00:57:23.314 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:23 smithi071 ceph-mon[23769]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:23.314 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:23 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3322609721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:57:23.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:23 smithi071 ceph-mon[28615]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:23.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:23 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3322609721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:57:23.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-mon[24697]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:23.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3322609721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:57:23.315 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 podman[41683]: 2024-09-17 00:57:23.114008013 +0000 UTC m=+2.404197173 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-09-17T00:57:23.315 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 podman[41683]: 2024-09-17 00:57:23.221146017 +0000 UTC m=+2.511335216 container create ce77f45249e4b449a7bcfaeb4b792bfe31fa8c3e3ba441899fa37a883aff28d7 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T00:57:23.587 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:57:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 podman[41683]: 2024-09-17 00:57:23.398893403 +0000 UTC m=+2.689082572 container init ce77f45249e4b449a7bcfaeb4b792bfe31fa8c3e3ba441899fa37a883aff28d7 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 podman[41683]: 2024-09-17 00:57:23.402115973 +0000 UTC m=+2.692305133 container start ce77f45249e4b449a7bcfaeb4b792bfe31fa8c3e3ba441899fa37a883aff28d7 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.406Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.406Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.406Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.406Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-09-17T00:57:23.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=arp 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=bcache 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=bonding 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=btrfs 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=conntrack 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=cpu 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=diskstats 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=dmi 2024-09-17T00:57:23.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=edac 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=entropy 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=filefd 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=filesystem 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=hwmon 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=infiniband 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=ipvs 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=loadavg 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=mdadm 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=meminfo 2024-09-17T00:57:23.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=netclass 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=netdev 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=netstat 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=nfs 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=nfsd 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=nvme 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=os 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=pressure 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=rapl 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=schedstat 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=sockstat 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=softnet 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=stat 2024-09-17T00:57:23.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=tapestats 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=textfile 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=time 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=uname 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=vmstat 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=xfs 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:115 level=info collector=zfs 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[41759]: ts=2024-09-17T00:57:23.407Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 bash[41683]: ce77f45249e4b449a7bcfaeb4b792bfe31fa8c3e3ba441899fa37a883aff28d7 2024-09-17T00:57:23.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 00:57:23 smithi135 systemd[1]: Started Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:57:23.790 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T00:57:23.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T00:57:24.036 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:24.424 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.425 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.425 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.425 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[23769]: Deploying daemon alertmanager.a on smithi071 2024-09-17T00:57:24.425 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.425 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.425 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.425 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:24 smithi071 ceph-mon[28615]: Deploying daemon alertmanager.a on smithi071 2024-09-17T00:57:24.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:24 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:24 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:24 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:24.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:24 smithi135 ceph-mon[24697]: Deploying daemon alertmanager.a on smithi071 2024-09-17T00:57:25.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:25 smithi135 ceph-mon[24697]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:25.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:25 smithi071 ceph-mon[28615]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:25.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:25 smithi071 ceph-mon[23769]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:27.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:57:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:27.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:57:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[23769]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[28615]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:27 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.947 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:27 smithi135 ceph-mon[24697]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:27.947 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:27 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.947 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:27 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.947 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:27 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:27.947 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:27 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:28.204 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:57:28.204 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"fsid":"e9235fcc-748e-11ef-bceb-c7b262605968","created":"2024-09-17T00:51:43.432593+0000","modified":"2024-09-17T00:56:51.910976+0000","last_up_change":"2024-09-17T00:56:33.633041+0000","last_in_change":"2024-09-17T00:56:15.698163+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T00:54:39.469053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"986e6205-636b-423b-9047-d512ca0fc630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6803","nonce":781779831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6805","nonce":781779831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6809","nonce":781779831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":781779831},{"type":"v1","addr":"172.21.15.71:6807","nonce":781779831}]},"public_addr":"172.21.15.71:6803/781779831","cluster_addr":"172.21.15.71:6805/781779831","heartbeat_back_addr":"172.21.15.71:6809/781779831","heartbeat_front_addr":"172.21.15.71:6807/781779831","state":["exists","up"]},{"osd":1,"uuid":"c73608df-2b7d-46de-bd3b-b7aa211724dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6811","nonce":2282566910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6813","nonce":2282566910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6817","nonce":2282566910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2282566910},{"type":"v1","addr":"172.21.15.71:6815","nonce":2282566910}]},"public_addr":"172.21.15.71:6811/2282566910","cluster_addr":"172.21.15.71:6813/2282566910","heartbeat_back_addr":"172.21.15.71:6817/2282566910","heartbeat_front_addr":"172.21.15.71:6815/2282566910","state":["exists","up"]},{"osd":2,"uuid":"b59c3a1c-d475-4e9c-9543-75634ad7452a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6819","nonce":1537007261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6821","nonce":1537007261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6825","nonce":1537007261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":1537007261},{"type":"v1","addr":"172.21.15.71:6823","nonce":1537007261}]},"public_addr":"172.21.15.71:6819/1537007261","cluster_addr":"172.21.15.71:6821/1537007261","heartbeat_back_addr":"172.21.15.71:6825/1537007261","heartbeat_front_addr":"172.21.15.71:6823/1537007261","state":["exists","up"]},{"osd":3,"uuid":"eb98b99e-fb27-4981-ae13-14ab172eebf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6827","nonce":3600348907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6829","nonce":3600348907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6833","nonce":3600348907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3600348907},{"type":"v1","addr":"172.21.15.71:6831","nonce":3600348907}]},"public_addr":"172.21.15.71:6827/3600348907","cluster_addr":"172.21.15.71:6829/3600348907","heartbeat_back_addr":"172.21.15.71:6833/3600348907","heartbeat_front_addr":"172.21.15.71:6831/3600348907","state":["exists","up"]},{"osd":4,"uuid":"df10eaa4-3b40-4e30-ad9e-5fb52b49bb0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6801","nonce":2260751041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6803","nonce":2260751041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6807","nonce":2260751041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2260751041},{"type":"v1","addr":"172.21.15.135:6805","nonce":2260751041}]},"public_addr":"172.21.15.135:6801/2260751041","cluster_addr":"172.21.15.135:6803/2260751041","heartbeat_back_addr":"172.21.15.135:6807/2260751041","heartbeat_front_addr":"172.21.15.135:6805/2260751041","state":["exists","up"]},{"osd":5,"uuid":"dd5b5284-b5db-4b6e-9401-13611a54aec0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6809","nonce":2586464427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6811","nonce":2586464427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6815","nonce":2586464427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2586464427},{"type":"v1","addr":"172.21.15.135:6813","nonce":2586464427}]},"public_addr":"172.21.15.135:6809/2586464427","cluster_addr":"172.21.15.135:6811/2586464427","heartbeat_back_addr":"172.21.15.135:6815/2586464427","heartbeat_front_addr":"172.21.15.135:6813/2586464427","state":["exists","up"]},{"osd":6,"uuid":"6f9e5591-ed3e-4405-adf1-12634536cd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6817","nonce":2277624576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6819","nonce":2277624576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6823","nonce":2277624576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2277624576},{"type":"v1","addr":"172.21.15.135:6821","nonce":2277624576}]},"public_addr":"172.21.15.135:6817/2277624576","cluster_addr":"172.21.15.135:6819/2277624576","heartbeat_back_addr":"172.21.15.135:6823/2277624576","heartbeat_front_addr":"172.21.15.135:6821/2277624576","state":["exists","up"]},{"osd":7,"uuid":"3cf11aaa-cd27-44c8-bd11-9b629c706c6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6825","nonce":2631825042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6827","nonce":2631825042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6831","nonce":2631825042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2631825042},{"type":"v1","addr":"172.21.15.135:6829","nonce":2631825042}]},"public_addr":"172.21.15.135:6825/2631825042","cluster_addr":"172.21.15.135:6827/2631825042","heartbeat_back_addr":"172.21.15.135:6831/2631825042","heartbeat_front_addr":"172.21.15.135:6829/2631825042","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:53:51.166646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:54:13.444327+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:54:36.976619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:00.820103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:25.017408+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:46.995753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:08.686609+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:32.287531+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6801/3941349606":"2024-09-18T00:56:51.910944+0000","172.21.15.71:6800/3941349606":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/3623700348":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/653059959":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/1610062920":"2024-09-18T00:52:31.106175+0000","172.21.15.71:6800/2786955802":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/3232619979":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/645001224":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/372115331":"2024-09-18T00:56:51.910944+0000","172.21.15.71:0/994352927":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6801/2786955802":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/806906688":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6800/3513527777":"2024-09-18T00:52:08.742069+0000","172.21.15.71:0/3673565773":"2024-09-18T00:52:31.106175+0000","172.21.15.71:0/1684728898":"2024-09-18T00:52:08.742069+0000","172.21.15.71:6801/3513527777":"2024-09-18T00:52:08.742069+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T00:57:28.750 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:28 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2369918612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:57:28.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:28 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2369918612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:57:28.946 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:28 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2369918612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:57:29.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:57:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:29.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T00:57:29.800 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T00:57:29.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T00:57:29.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T00:57:29.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T00:57:29.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T00:57:29.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-17T00:57:29.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-17T00:57:29.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:29 smithi135 ceph-mon[24697]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:29 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:29 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:30.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:29 smithi071 ceph-mon[23769]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:30.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:29 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:30.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:29 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:30.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:29 smithi071 ceph-mon[28615]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:30.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:29 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:30.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:29 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:31.074 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:31.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:31 smithi071 ceph-mon[23769]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:31.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:31 smithi071 ceph-mon[28615]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:31.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:31 smithi135 ceph-mon[24697]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:32.306 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:32.313 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:32.747 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:32.748 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:32.748 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:32.748 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:32.749 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:33.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:33 smithi071 ceph-mon[23769]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:33 smithi071 ceph-mon[28615]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:33.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:33 smithi135 ceph-mon[24697]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:35.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:35 smithi135 ceph-mon[24697]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:36.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:35 smithi071 ceph-mon[28615]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:36.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:35 smithi071 ceph-mon[23769]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:36.646 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 podman[46316]: 2024-09-17 00:57:36.460189012 +0000 UTC m=+1.471290858 container create 4a0479c8d1430ff5e30bdff5bf46ab31bfdcaa226ce0007639b5cf9101a2d95d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:36.935 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 podman[46316]: 2024-09-17 00:57:36.923441523 +0000 UTC m=+1.934543371 container init 4a0479c8d1430ff5e30bdff5bf46ab31bfdcaa226ce0007639b5cf9101a2d95d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:36.935 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 podman[46316]: 2024-09-17 00:57:36.926434501 +0000 UTC m=+1.937536347 container start 4a0479c8d1430ff5e30bdff5bf46ab31bfdcaa226ce0007639b5cf9101a2d95d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:57:37.188 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.937Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-09-17T00:57:37.188 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.937Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-09-17T00:57:37.188 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.939Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.71 port=9094 2024-09-17T00:57:37.188 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.940Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-17T00:57:37.188 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.966Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T00:57:37.188 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.966Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T00:57:37.188 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.968Z caller=main.go:518 msg=Listening address=:9093 2024-09-17T00:57:37.189 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:36.969Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-09-17T00:57:37.189 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:37 smithi071 bash[46316]: 4a0479c8d1430ff5e30bdff5bf46ab31bfdcaa226ce0007639b5cf9101a2d95d 2024-09-17T00:57:37.189 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:37 smithi071 systemd[1]: Started Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:57:37.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[23769]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:37.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:57:37.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.788 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[28615]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:37.788 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:57:37.789 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:37 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:37 smithi135 ceph-mon[24697]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:37 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:37 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:37 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:37 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:57:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:37 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:38.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:38 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:57:38.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:38 smithi071 ceph-mon[28615]: Deploying daemon grafana.a on smithi135 2024-09-17T00:57:38.751 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:38 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:57:38.751 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:38 smithi071 ceph-mon[23769]: Deploying daemon grafana.a on smithi135 2024-09-17T00:57:38.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:38 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:57:38.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:38 smithi135 ceph-mon[24697]: Deploying daemon grafana.a on smithi135 2024-09-17T00:57:39.032 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:38 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:38.940Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000067544s 2024-09-17T00:57:39.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:39 smithi071 ceph-mon[28615]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:39.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:39 smithi071 ceph-mon[23769]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:39.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:39 smithi135 ceph-mon[24697]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:41.134 INFO:teuthology.orchestra.run.smithi071.stdout:193273528339 2024-09-17T00:57:41.134 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-17T00:57:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:41 smithi071 ceph-mon[23769]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:41.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:41 smithi071 ceph-mon[28615]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:41.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:41 smithi135 ceph-mon[24697]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:42.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:42 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:57:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:43.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:43 smithi135 ceph-mon[24697]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:43.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:43 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:43 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:43.301 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:43 smithi071 ceph-mon[28615]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:43.302 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:43 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:43.302 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:43 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:43.302 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:43 smithi071 ceph-mon[23769]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:43.302 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:43 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:43.302 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:43 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:45.357 INFO:teuthology.orchestra.run.smithi071.stdout:107374182434 2024-09-17T00:57:45.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T00:57:45.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:45 smithi135 ceph-mon[24697]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:46.115 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:45 smithi071 ceph-mon[23769]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:46.115 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:45 smithi071 ceph-mon[28615]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:46.122 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:46.356 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:46.940 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:57:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:47.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:57:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:57:46.943Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.002347873s 2024-09-17T00:57:48.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:47 smithi071 ceph-mon[23769]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:48.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:47 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:48.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:47 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:48.017 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:47 smithi071 ceph-mon[28615]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:48.017 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:47 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:48.017 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:47 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:48.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:47 smithi135 ceph-mon[24697]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:48.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:47 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:48.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:47 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:49.813 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:49 smithi135 systemd[1]: Starting Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:57:50.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:49 smithi071 ceph-mon[23769]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:50.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:49 smithi071 ceph-mon[28615]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:50.092 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:49 smithi135 ceph-mon[24697]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:50.092 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:49 smithi135 podman[42754]: 2024-09-17 00:57:49.850341747 +0000 UTC m=+0.015123250 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-09-17T00:57:50.092 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:49 smithi135 podman[42754]: 2024-09-17 00:57:49.989465681 +0000 UTC m=+0.154247172 container create 8f7134c93bd0894c73500873172ae7dd78370ec7c131cdd63c8c6ec28e79161d (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-03-28T10:36:18.413762, io.openshift.expose-services=, description=Ceph Grafana Container, maintainer=Paul Cuzner , name=ubi8, com.redhat.component=ubi8-container, version=8.5, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, release=236.1648460182, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.24.2, distribution-scope=public) 2024-09-17T00:57:50.344 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 podman[42754]: 2024-09-17 00:57:50.217127946 +0000 UTC m=+0.381909449 container init 8f7134c93bd0894c73500873172ae7dd78370ec7c131cdd63c8c6ec28e79161d (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, architecture=x86_64, maintainer=Paul Cuzner , release=236.1648460182, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.component=ubi8-container, version=8.5, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=ubi8, io.openshift.tags=base rhel8, summary=Grafana Container configured for Ceph mgr/dashboard integration, distribution-scope=public, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, io.openshift.expose-services=, vcs-type=git) 2024-09-17T00:57:50.344 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 podman[42754]: 2024-09-17 00:57:50.219987522 +0000 UTC m=+0.384769015 container start 8f7134c93bd0894c73500873172ae7dd78370ec7c131cdd63c8c6ec28e79161d (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, version=8.5, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, distribution-scope=public, architecture=x86_64, io.openshift.expose-services=, build-date=2022-03-28T10:36:18.413762, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, release=236.1648460182, name=ubi8, io.buildah.version=1.24.2, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.component=ubi8-container, description=Ceph Grafana Container, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8) 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-09-17T00:57:50.345 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="App mode production" logger=settings 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-09-17T00:57:50.346 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-09-17T00:57:50.347 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-09-17T00:57:50.347 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-09-17T00:57:50.348 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-17T00:57:50.349 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-09-17T00:57:50.350 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-09-17T00:57:50.351 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-09-17T00:57:50.352 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-09-17T00:57:50.353 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-17T00:57:50.354 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 bash[42754]: 8f7134c93bd0894c73500873172ae7dd78370ec7c131cdd63c8c6ec28e79161d 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 systemd[1]: Started Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-09-17T00:57:50.355 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-09-17T00:57:50.356 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-09-17T00:57:50.356 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-09-17T00:57:50.356 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-09-17T00:57:50.356 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-09-17T00:57:50.356 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-09-17T00:57:50.356 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-09-17T00:57:50.595 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-09-17T00:57:50.596 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-09-17T00:57:50.597 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-09-17T00:57:50.598 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-09-17T00:57:50.598 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-09-17T00:57:50.598 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-17T00:57:50.598 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-09-17T00:57:50.598 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-09-17T00:57:50.600 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-09-17T00:57:50.601 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-09-17T00:57:50.602 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-09-17T00:57:50.603 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-09-17T00:57:50.603 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-09-17T00:57:50.603 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-09-17T00:57:50.603 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-09-17T00:57:50.603 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-09-17T00:57:50.603 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-09-17T00:57:50.603 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-09-17T00:57:50.604 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-09-17T00:57:50.605 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-09-17T00:57:50.606 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-09-17T00:57:50.607 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-09-17T00:57:50.608 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-09-17T00:57:50.609 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-17T00:57:50.610 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-09-17T00:57:50.611 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-09-17T00:57:50.611 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-09-17T00:57:50.611 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-09-17T00:57:50.611 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-09-17T00:57:50.611 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-09-17T00:57:50.611 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-09-17T00:57:50.611 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-09-17T00:57:50.612 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-09-17T00:57:50.613 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-09-17T00:57:50.614 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-09-17T00:57:50.614 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-09-17T00:57:50.614 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-17T00:57:50.614 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-17T00:57:50.614 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-17T00:57:50.614 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-09-17T00:57:50.614 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-09-17T00:57:50.615 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-17T00:57:50.615 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-17T00:57:50.615 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-09-17T00:57:50.615 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-17T00:57:50.615 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-09-17T00:57:50.615 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-09-17T00:57:50.796 INFO:teuthology.orchestra.run.smithi071.stdout:227633266703 2024-09-17T00:57:50.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-17T00:57:50.903 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-09-17T00:57:50.903 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-17T00:57:50.903 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-09-17T00:57:50.903 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-17T00:57:50.904 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-09-17T00:57:50.905 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-17T00:57:50.905 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-17T00:57:50.905 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-17T00:57:50.905 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-09-17T00:57:50.906 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-09-17T00:57:50.907 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-09-17T00:57:50.908 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=423.296692ms 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-09-17T00:57:50.909 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-09-17T00:57:50.910 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-17T00:57:50.910 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-09-17T00:57:50.910 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-09-17T00:57:50.910 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 00:57:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T00:57:50+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T00:57:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[28615]: Reconfiguring daemon alertmanager.a on smithi071 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T00:57:51.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:51 smithi071 ceph-mon[23769]: Reconfiguring daemon alertmanager.a on smithi071 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T00:57:51.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:51 smithi135 ceph-mon[24697]: Reconfiguring daemon alertmanager.a on smithi071 2024-09-17T00:57:53.004 INFO:teuthology.orchestra.run.smithi071.stdout:158913789978 2024-09-17T00:57:53.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T00:57:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:53 smithi135 ceph-mon[24697]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:53 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:57:53.061 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:53 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:57:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:57:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:57:53.062 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:53 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2217542948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[28615]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2217542948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[23769]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:53.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:53.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:57:53.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:57:53.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:57:53.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:57:53.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:53 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2217542948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-17T00:57:54.001 INFO:teuthology.orchestra.run.smithi071.stdout:34359738416 2024-09-17T00:57:54.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T00:57:55.218 INFO:teuthology.orchestra.run.smithi071.stdout:193273528341 2024-09-17T00:57:55.277 INFO:teuthology.orchestra.run.smithi071.stdout:107374182436 2024-09-17T00:57:55.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:55 smithi135 ceph-mon[24697]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:55.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:55 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3595576875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T00:57:55.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:55 smithi071 ceph-mon[28615]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:55.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:55 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3595576875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T00:57:55.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:55 smithi071 ceph-mon[23769]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:55.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:55 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3595576875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T00:57:56.282 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:57:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:56.309 INFO:teuthology.orchestra.run.smithi071.stdout:55834574892 2024-09-17T00:57:56.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T00:57:57.066 INFO:teuthology.orchestra.run.smithi071.stdout:77309411369 2024-09-17T00:57:57.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T00:57:57.346 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:57 smithi071 ceph-mon[23769]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:57.346 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:57 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:57.347 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:57 smithi071 ceph-mon[28615]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:57.347 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:57 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:57.368 INFO:teuthology.orchestra.run.smithi071.stdout:128849018910 2024-09-17T00:57:57.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T00:57:57.458 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:57 smithi135 ceph-mon[24697]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:57.458 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:57 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:57.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:57:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:57:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:57:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:58.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:58 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:58.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:58 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:58.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:58 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:58.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:58 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:58.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:58 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:58.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:58 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:57:59.369 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528339 got 193273528341 for osd.6 2024-09-17T00:57:59.369 DEBUG:teuthology.parallel:result is None 2024-09-17T00:57:59.586 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:59.587 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:57:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:57:59 smithi071 ceph-mon[23769]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:59.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:57:59 smithi071 ceph-mon[28615]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:59.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:57:59 smithi135 ceph-mon[24697]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:57:59.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182434 got 107374182436 for osd.3 2024-09-17T00:57:59.985 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:01.129 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:58:01.129 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:58:01.741 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:01 smithi071 ceph-mon[23769]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:01.742 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:01 smithi071 ceph-mon[28615]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:01.742 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:01 smithi071 systemd[1]: Stopping Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:58:01.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:01 smithi135 ceph-mon[24697]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:02.768 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:58:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:02.768 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:02 smithi071 bash[47955]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager.a" found: no such container 2024-09-17T00:58:03.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:03 smithi071 ceph-mon[28615]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:03.770 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:03 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:03.771 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:03 smithi071 ceph-mon[23769]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:03.771 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:03 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:03.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:03 smithi135 ceph-mon[24697]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:03.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:03 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:58:04.518 INFO:teuthology.orchestra.run.smithi071.stdout:227633266707 2024-09-17T00:58:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:04 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1066563921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-17T00:58:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:04 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1066563921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-17T00:58:04.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:04 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1066563921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-17T00:58:05.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:05 smithi135 ceph-mon[24697]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:05.986 INFO:teuthology.orchestra.run.smithi071.stdout:158913789982 2024-09-17T00:58:05.986 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:05 smithi071 ceph-mon[23769]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:05.987 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:05 smithi071 ceph-mon[28615]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:05.987 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:05 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[46379]: level=info ts=2024-09-17T00:58:05.897Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-09-17T00:58:06.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:06 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3628175672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T00:58:06.990 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:06 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3628175672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T00:58:06.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:06 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3628175672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T00:58:07.016 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789978 got 158913789982 for osd.5 2024-09-17T00:58:07.016 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:07.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:07 smithi071 ceph-mon[23769]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:07.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:07 smithi071 ceph-mon[28615]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:07.897 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266703 got 227633266707 for osd.7 2024-09-17T00:58:07.897 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:07.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:07 smithi135 ceph-mon[24697]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:08.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:08 smithi071 podman[48019]: 2024-09-17 00:58:08.068962887 +0000 UTC m=+5.554896504 container died 4a0479c8d1430ff5e30bdff5bf46ab31bfdcaa226ce0007639b5cf9101a2d95d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:09.111 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:08 smithi071 podman[48019]: 2024-09-17 00:58:08.904976518 +0000 UTC m=+6.390910133 container cleanup 4a0479c8d1430ff5e30bdff5bf46ab31bfdcaa226ce0007639b5cf9101a2d95d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:09.112 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:08 smithi071 bash[48019]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a 2024-09-17T00:58:09.366 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:09 smithi071 podman[48204]: 2024-09-17 00:58:09.114498812 +0000 UTC m=+3.168896982 container remove 4a0479c8d1430ff5e30bdff5bf46ab31bfdcaa226ce0007639b5cf9101a2d95d (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:09.366 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:09 smithi071 podman[48204]: 2024-09-17 00:58:09.215333376 +0000 UTC m=+3.269731498 volume remove 6d9f4ca6662a7c30e458a6cda4980452b46f82ca158405bee0c888603af0318d 2024-09-17T00:58:09.934 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:09 smithi071 ceph-mon[28615]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:09.935 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:09 smithi071 ceph-mon[23769]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:09.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:09 smithi135 ceph-mon[24697]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:10.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:09 smithi071 bash[48304]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager.a" found: no such container 2024-09-17T00:58:10.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:09 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-17T00:58:10.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:09 smithi071 systemd[1]: Stopped Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:58:10.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:09 smithi071 systemd[1]: Starting Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:58:11.480 INFO:teuthology.orchestra.run.smithi071.stdout:34359738421 2024-09-17T00:58:11.732 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:11 smithi071 ceph-mon[28615]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:11.732 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:11 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1307838680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T00:58:11.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:11 smithi071 ceph-mon[23769]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:11.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:11 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1307838680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T00:58:11.846 INFO:teuthology.orchestra.run.smithi071.stdout:77309411373 2024-09-17T00:58:11.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:11 smithi135 ceph-mon[24697]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:11.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:11 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1307838680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T00:58:12.518 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411369 got 77309411373 for osd.2 2024-09-17T00:58:12.518 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:12.797 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:12 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3847158702' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T00:58:12.797 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:12 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/533332426' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T00:58:12.932 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:12 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3847158702' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T00:58:12.932 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:12 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/533332426' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T00:58:12.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:12 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3847158702' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T00:58:12.933 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:12 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/533332426' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T00:58:13.208 INFO:teuthology.orchestra.run.smithi071.stdout:128849018914 2024-09-17T00:58:13.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:13 smithi071 ceph-mon[28615]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:13.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:13 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3058735439' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T00:58:13.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:13 smithi071 ceph-mon[23769]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:13.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:13 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3058735439' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T00:58:13.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:13 smithi135 ceph-mon[24697]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:13.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:13 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3058735439' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T00:58:13.883 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738416 got 34359738421 for osd.0 2024-09-17T00:58:13.883 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:14.050 INFO:teuthology.orchestra.run.smithi071.stdout:55834574897 2024-09-17T00:58:14.145 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:58:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:14.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018910 got 128849018914 for osd.4 2024-09-17T00:58:14.754 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:15.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:14 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:15.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:14 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:15.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:14 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:15.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:14 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:15.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:14 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:15.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:14 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:15.445 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574892 got 55834574897 for osd.1 2024-09-17T00:58:15.445 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:15.445 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T00:58:15.446 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T00:58:15.667 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:15 smithi071 podman[48620]: 2024-09-17 00:58:15.586969572 +0000 UTC m=+1.631263572 volume create cc208d0544c475bb6baead9a334975e8ce748c9f3dfe3abc6d81272d22a8c805 2024-09-17T00:58:15.667 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:15 smithi071 podman[48620]: 2024-09-17 00:58:15.503208193 +0000 UTC m=+1.547502193 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-09-17T00:58:16.003 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:15 smithi071 ceph-mon[23769]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:16.006 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:15 smithi071 ceph-mon[28615]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:16.006 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:15 smithi071 podman[48620]: 2024-09-17 00:58:15.670611758 +0000 UTC m=+1.714905755 container create 3a13fcf748bf15cf7cedaec4a48543435a7753a23750f8e7544c93f8c8646e71 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:16.183 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:15 smithi135 ceph-mon[24697]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:58:16.300 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 podman[48620]: 2024-09-17 00:58:16.006608302 +0000 UTC m=+2.050902303 container init 3a13fcf748bf15cf7cedaec4a48543435a7753a23750f8e7544c93f8c8646e71 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:16.300 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 podman[48620]: 2024-09-17 00:58:16.009690251 +0000 UTC m=+2.053984250 container start 3a13fcf748bf15cf7cedaec4a48543435a7753a23750f8e7544c93f8c8646e71 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:16.300 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.019Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.019Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.020Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.71 port=9094 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.022Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.046Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.047Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.049Z caller=main.go:518 msg=Listening address=:9093 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:16.049Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 bash[48620]: 3a13fcf748bf15cf7cedaec4a48543435a7753a23750f8e7544c93f8c8646e71 2024-09-17T00:58:16.301 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:16 smithi071 systemd[1]: Started Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:58:17.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[28615]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:17.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:17.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[28615]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T00:58:17.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[28615]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T00:58:17.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[23769]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:17.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:17.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[23769]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T00:58:17.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:17 smithi071 ceph-mon[23769]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T00:58:17.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:17 smithi135 ceph-mon[24697]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:17.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:17 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:17.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:17 smithi135 ceph-mon[24697]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T00:58:17.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:17 smithi135 ceph-mon[24697]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T00:58:18.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:58:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:18.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:18.022Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000487601s 2024-09-17T00:58:19.255 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-mon[24697]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:19.255 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:19.256 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 systemd[1]: Stopping Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:58:19.256 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 bash[43850]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus.a" found: no such container 2024-09-17T00:58:19.332 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:58:19.332 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:19 smithi071 ceph-mon[23769]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:19.332 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:19 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:19.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:19 smithi071 ceph-mon[28615]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:19.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:19 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:19.335 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-17T00:58:19.605 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.257Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T00:58:19.605 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-09-17T00:58:19.605 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-09-17T00:58:19.606 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-09-17T00:58:19.606 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-09-17T00:58:19.606 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T00:58:19.606 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T00:58:19.606 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-09-17T00:58:19.606 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-09-17T00:58:19.607 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T00:58:19.607 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-09-17T00:58:19.607 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[40742]: ts=2024-09-17T00:58:19.258Z caller=main.go:1066 level=info msg="See you next time!" 2024-09-17T00:58:19.607 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 podman[43861]: 2024-09-17 00:58:19.268262744 +0000 UTC m=+0.123461822 container died d15ae95e597f4f2a00d25995dfc73491933ce9f5bae24a0ab789f6ff84654b0f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:19.607 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 podman[43861]: 2024-09-17 00:58:19.608090759 +0000 UTC m=+0.463289837 container cleanup d15ae95e597f4f2a00d25995dfc73491933ce9f5bae24a0ab789f6ff84654b0f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:19.607 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 bash[43861]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T00:58:19.857 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 podman[43873]: 2024-09-17 00:58:19.841890241 +0000 UTC m=+0.571632292 container remove d15ae95e597f4f2a00d25995dfc73491933ce9f5bae24a0ab789f6ff84654b0f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:19.923 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-17T00:58:17.988077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48784,"kb_used_data":6032,"kb_used_omap":0,"kb_used_meta":42688,"kb_avail":749912432,"statfs":{"total":767960285184,"available":767910330368,"internally_reserved":0,"allocated":6176768,"data_stored":3455542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43712512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002011"},"pg_stats":[{"pgid":"1.0","version":"58'128","reported_seq":266,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T00:56:52.055191+0000","last_change":"2024-09-17T00:56:37.900664+0000","last_active":"2024-09-17T00:56:52.055191+0000","last_peered":"2024-09-17T00:56:52.055191+0000","last_clean":"2024-09-17T00:56:52.055191+0000","last_became_active":"2024-09-17T00:56:37.900196+0000","last_became_peered":"2024-09-17T00:56:37.900196+0000","last_unstale":"2024-09-17T00:56:52.055191+0000","last_undegraded":"2024-09-17T00:56:52.055191+0000","last_fullsized":"2024-09-17T00:56:52.055191+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T00:54:39.927984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T00:54:39.927984+0000","last_clean_scrub_stamp":"2024-09-17T00:54:39.927984+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:14.868683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":53,"seq":227633266710,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6080,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739072,"statfs":{"total":95995035648,"available":95988809728,"internally_reserved":0,"allocated":1105920,"data_stored":762590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63700000000000001}]},{"osd":3,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.68100000000000005}]},{"osd":4,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65600000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6144,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739008,"statfs":{"total":95995035648,"available":95988744192,"internally_reserved":0,"allocated":1105920,"data_stored":762590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Tue Sep 17 00:57:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Sep 17 00:57:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48799999999999999}]},{"osd":3,"last update":"Tue Sep 17 00:57:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.56399999999999995}]},{"osd":4,"last update":"Tue Sep 17 00:57:11 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.45600000000000002}]},{"osd":5,"last update":"Tue Sep 17 00:57:11 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.62}]},{"osd":7,"last update":"Tue Sep 17 00:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6328,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738824,"statfs":{"total":95995035648,"available":95988555776,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.316},"min":{"1min":0.23999999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.32900000000000001},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Tue Sep 17 00:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.378,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.498}]},{"osd":3,"last update":"Tue Sep 17 00:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61899999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42699999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.54200000000000004}]},{"osd":4,"last update":"Tue Sep 17 00:57:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":1.056,"15min":1.1439999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76200000000000001,"5min":10.209,"15min":10.209},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.96299999999999997}]},{"osd":5,"last update":"Tue Sep 17 00:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83199999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.91600000000000004}]},{"osd":6,"last update":"Tue Sep 17 00:57:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.89500000000000002}]},{"osd":7,"last update":"Tue Sep 17 00:57:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6912,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738240,"statfs":{"total":95995035648,"available":95987957760,"internally_reserved":0,"allocated":1105920,"data_stored":762590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 00:57:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.25700000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48899999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.36399999999999999,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.378}]},{"osd":2,"last update":"Tue Sep 17 00:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50800000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.377,"15min":0.375},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.48299999999999998}]},{"osd":3,"last update":"Tue Sep 17 00:58:10 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47899999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.41699999999999998}]},{"osd":4,"last update":"Tue Sep 17 00:57:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.751},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.627}]},{"osd":5,"last update":"Tue Sep 17 00:57:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Sep 17 00:57:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.80700000000000005}]},{"osd":7,"last update":"Tue Sep 17 00:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.76600000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6264,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738888,"statfs":{"total":95995035648,"available":95988621312,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36299999999999999},"min":{"1min":0.25900000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.39900000000000002}]},{"osd":1,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53200000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.373}]},{"osd":3,"last update":"Tue Sep 17 00:57:08 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41899999999999998,"15min":0.42299999999999999},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54100000000000004,"5min":0.62,"15min":0.62},"last":0.435},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.308,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.44700000000000001}]},{"osd":4,"last update":"Tue Sep 17 00:57:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Sep 17 00:57:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59399999999999997}]},{"osd":7,"last update":"Tue Sep 17 00:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60699999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182440,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5688,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739464,"statfs":{"total":95995035648,"available":95989211136,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35299999999999998},"min":{"1min":0.25800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.26600000000000001}]},{"osd":1,"last update":"Tue Sep 17 00:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":0.624,"15min":0.624},"last":0.311}]},{"osd":2,"last update":"Tue Sep 17 00:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42099999999999999,"15min":0.42599999999999999},"min":{"1min":0.307,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.373},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.25800000000000001}]},{"osd":4,"last update":"Tue Sep 17 00:57:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.41799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.91500000000000004,"15min":0.97299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.755,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.61699999999999999}]},{"osd":5,"last update":"Tue Sep 17 00:57:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79400000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73899999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Sep 17 00:57:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.59599999999999997}]},{"osd":7,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54600000000000004}]}]},{"osd":4,"up_from":30,"seq":128849018915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5752,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739400,"statfs":{"total":95995035648,"available":95989145600,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.624,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.59299999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.5,"15min":0.5},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.67600000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46400000000000002}]},{"osd":2,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63700000000000001,"5min":0.753,"15min":0.753},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.501},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67200000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.51200000000000001}]},{"osd":5,"last update":"Tue Sep 17 00:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38100000000000001,"15min":0.375},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Sep 17 00:57:13 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.443},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Sep 17 00:57:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.39500000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5616,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739536,"statfs":{"total":95995035648,"available":95989284864,"internally_reserved":0,"allocated":565248,"data_stored":233124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":0.63800000000000001,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":12.653,"5min":12.653,"15min":12.653},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.123,"5min":0.63100000000000001,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":12.68,"5min":12.68,"15min":12.68},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":0.747,"15min":0.747},"last":0.38200000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":0.622,"15min":0.53600000000000003},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":12.603999999999999,"5min":12.603999999999999,"15min":12.603999999999999},"last":0.495}]},{"osd":2,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.65100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40899999999999997}]},{"osd":3,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64800000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.442},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.435}]},{"osd":4,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60099999999999998,"5min":0.627,"15min":0.627},"last":0.36899999999999999}]},{"osd":6,"last update":"Tue Sep 17 00:57:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Sep 17 00:57:36 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T00:58:19.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T00:58:20.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-mon[24697]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:20.115 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 bash[43888]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus.a" found: no such container 2024-09-17T00:58:20.115 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-17T00:58:20.115 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 systemd[1]: Stopped Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:58:20.115 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:19 smithi135 systemd[1]: Starting Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T00:58:20.115 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 podman[43949]: 2024-09-17 00:58:19.995822422 +0000 UTC m=+0.016897850 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-09-17T00:58:20.116 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 podman[43949]: 2024-09-17 00:58:20.117689202 +0000 UTC m=+0.138764654 container create c1395755c3611790a610e504f9f9af7ae37e2a9a7d0549851835c3991110e03d (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:20.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:20 smithi071 ceph-mon[23769]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:20.176 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:20 smithi071 ceph-mon[28615]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:20.365 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 podman[43949]: 2024-09-17 00:58:20.336707001 +0000 UTC m=+0.357782428 container init c1395755c3611790a610e504f9f9af7ae37e2a9a7d0549851835c3991110e03d (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:20.365 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 podman[43949]: 2024-09-17 00:58:20.339483943 +0000 UTC m=+0.360559352 container start c1395755c3611790a610e504f9f9af7ae37e2a9a7d0549851835c3991110e03d (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T00:58:20.365 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.361Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-09-17T00:58:20.365 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.361Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-09-17T00:58:20.365 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.361Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-09-17T00:58:20.365 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.361Z caller=main.go:518 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi135 (none))" 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.362Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.362Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.363Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.364Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.364Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.366Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.366Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.584µs 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.366Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.367Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.368Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-17T00:58:20.366 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.368Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=36.398µs wal_replay_duration=1.774071ms total_replay_duration=1.831783ms 2024-09-17T00:58:20.655 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:58:20.709 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.368Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T00:58:20.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.368Z caller=main.go:947 level=info msg="TSDB started" 2024-09-17T00:58:20.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.368Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T00:58:20.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.384Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=15.420439ms db_storage=786ns remote_storage=1.752µs web_handler=559ns query_engine=699ns scrape=629.933µs scrape_sd=49.467µs notify=42.23µs notify_sd=18.497µs rules=14.047979ms 2024-09-17T00:58:20.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T00:58:20.384Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-09-17T00:58:20.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 bash[43949]: c1395755c3611790a610e504f9f9af7ae37e2a9a7d0549851835c3991110e03d 2024-09-17T00:58:20.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 00:58:20 smithi135 systemd[1]: Started Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T00:58:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:58:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:58:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.71:9093"}]: dispatch 2024-09-17T00:58:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.71:9093"}]: dispatch 2024-09-17T00:58:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.135:3000"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.135:3000"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:58:21.746 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:21.746 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.746 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:58:21.746 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:58:21.746 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.71:9093"}]: dispatch 2024-09-17T00:58:21.746 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.71:9093"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.135:3000"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.135:3000"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:58:21.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.71:9093"}]: dispatch 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.71:9093"}]: dispatch 2024-09-17T00:58:21.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.135:3000"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.135:3000"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.749 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:21.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:21.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:21.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:58:23.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:22 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:58:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[23769]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[28615]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:23 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:24.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:23 smithi135 ceph-mon[24697]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:24.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:23 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:24.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:23 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:24.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:23 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:24.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:23 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:24.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:23 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:24.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:23 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:58:25.285 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-17T00:58:26.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:25 smithi071 ceph-mon[23769]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:26.023 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:25 smithi071 ceph-mon[28615]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:26.087 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-17T00:58:23.989390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48784,"kb_used_data":6032,"kb_used_omap":0,"kb_used_meta":42688,"kb_avail":749912432,"statfs":{"total":767960285184,"available":767910330368,"internally_reserved":0,"allocated":6176768,"data_stored":3455542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43712512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002236"},"pg_stats":[{"pgid":"1.0","version":"58'128","reported_seq":266,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T00:56:52.055191+0000","last_change":"2024-09-17T00:56:37.900664+0000","last_active":"2024-09-17T00:56:52.055191+0000","last_peered":"2024-09-17T00:56:52.055191+0000","last_clean":"2024-09-17T00:56:52.055191+0000","last_became_active":"2024-09-17T00:56:37.900196+0000","last_became_peered":"2024-09-17T00:56:37.900196+0000","last_unstale":"2024-09-17T00:56:52.055191+0000","last_undegraded":"2024-09-17T00:56:52.055191+0000","last_fullsized":"2024-09-17T00:56:52.055191+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T00:54:39.927984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T00:54:39.927984+0000","last_clean_scrub_stamp":"2024-09-17T00:54:39.927984+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:14.868683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":53,"seq":227633266712,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6080,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739072,"statfs":{"total":95995035648,"available":95988809728,"internally_reserved":0,"allocated":1105920,"data_stored":762590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.71299999999999997}]},{"osd":4,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.51600000000000001}]},{"osd":5,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.49299999999999999}]},{"osd":6,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56000000000000005}]}]},{"osd":6,"up_from":45,"seq":193273528348,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6144,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739008,"statfs":{"total":95995035648,"available":95988744192,"internally_reserved":0,"allocated":1105920,"data_stored":762590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.39300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70099999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.38700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67200000000000004,"5min":0.748,"15min":0.748},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.054,"5min":0.64000000000000001,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":10.879,"5min":10.879,"15min":10.879},"last":0.48699999999999999}]},{"osd":2,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70299999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.61499999999999999,"15min":0.54200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":10.859999999999999,"5min":10.859999999999999,"15min":10.859999999999999},"last":0.51600000000000001}]},{"osd":3,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.66000000000000003,"15min":0.58699999999999997},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.898,"5min":10.898,"15min":10.898},"last":0.45200000000000001}]},{"osd":4,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.435,"15min":0.434},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.60599999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.52900000000000003}]},{"osd":5,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.64400000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Sep 17 00:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.621},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.69699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6328,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738824,"statfs":{"total":95995035648,"available":95988555776,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:17 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33400000000000002,"15min":0.318},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36599999999999999,"15min":0.33200000000000002},"min":{"1min":0.23499999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Tue Sep 17 00:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.378,"15min":0.376},"min":{"1min":0.26700000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51800000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.247},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Tue Sep 17 00:58:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44,"15min":0.44400000000000001},"min":{"1min":0.32600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61899999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42699999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.35099999999999998}]},{"osd":4,"last update":"Tue Sep 17 00:57:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":1.056,"15min":1.1439999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76200000000000001,"5min":10.209,"15min":10.209},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83899999999999997,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Sep 17 00:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83199999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Sep 17 00:58:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88700000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":1.095,"15min":1.095},"last":0.50900000000000001}]},{"osd":7,"last update":"Tue Sep 17 00:57:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.5}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6912,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738240,"statfs":{"total":95995035648,"available":95987957760,"internally_reserved":0,"allocated":1105920,"data_stored":762590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 00:57:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.25700000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48899999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.36399999999999999,"15min":0.35799999999999998},"min":{"1min":0.26600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.45500000000000002}]},{"osd":2,"last update":"Tue Sep 17 00:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50800000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.377,"15min":0.375},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.34499999999999997}]},{"osd":3,"last update":"Tue Sep 17 00:58:10 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47899999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Tue Sep 17 00:57:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54800000000000004}]},{"osd":5,"last update":"Tue Sep 17 00:57:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Sep 17 00:58:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56000000000000005}]},{"osd":7,"last update":"Tue Sep 17 00:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6264,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738888,"statfs":{"total":95995035648,"available":95988621312,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36299999999999999},"min":{"1min":0.25900000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.317}]},{"osd":1,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39700000000000002,"15min":0.38500000000000001},"min":{"1min":0.28499999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53200000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Tue Sep 17 00:58:14 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.41999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61599999999999999,"5min":0.62,"15min":0.62},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.33800000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.36799999999999999}]},{"osd":4,"last update":"Tue Sep 17 00:57:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52600000000000002}]},{"osd":5,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.497}]},{"osd":6,"last update":"Tue Sep 17 00:58:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70799999999999996,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.50900000000000001}]},{"osd":7,"last update":"Tue Sep 17 00:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57699999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5688,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739464,"statfs":{"total":95995035648,"available":95989211136,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35299999999999998},"min":{"1min":0.25800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.55700000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.22500000000000001}]},{"osd":1,"last update":"Tue Sep 17 00:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.28000000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57099999999999995,"5min":0.624,"15min":0.624},"last":0.29399999999999998}]},{"osd":2,"last update":"Tue Sep 17 00:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42099999999999999,"15min":0.42599999999999999},"min":{"1min":0.307,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.309}]},{"osd":4,"last update":"Tue Sep 17 00:57:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.41799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89200000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.91500000000000004,"15min":0.97299999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.755,"5min":9.6199999999999992,"15min":9.6199999999999992},"last":0.503}]},{"osd":5,"last update":"Tue Sep 17 00:57:53 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79400000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.73899999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.627}]},{"osd":6,"last update":"Tue Sep 17 00:58:20 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59299999999999997}]},{"osd":7,"last update":"Tue Sep 17 00:57:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47699999999999998}]}]},{"osd":4,"up_from":30,"seq":128849018917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5752,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739400,"statfs":{"total":95995035648,"available":95989145600,"internally_reserved":0,"allocated":573440,"data_stored":233662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.624,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.59299999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60199999999999998}]},{"osd":1,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.627},{"interface":"front","average":{"1min":0.504,"5min":0.5,"15min":0.5},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.67600000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48499999999999999,"15min":0.48399999999999999},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71399999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63700000000000001,"5min":0.753,"15min":0.753},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Sep 17 00:57:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.38900000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67200000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Tue Sep 17 00:57:52 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.38100000000000001,"15min":0.375},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Sep 17 00:57:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70499999999999996}]}]},{"osd":5,"up_from":37,"seq":158913789986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5616,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739536,"statfs":{"total":95995035648,"available":95989284864,"internally_reserved":0,"allocated":565248,"data_stored":233124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":0.63800000000000001,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":12.653,"5min":12.653,"15min":12.653},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.123,"5min":0.63100000000000001,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":12.68,"5min":12.68,"15min":12.68},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73599999999999999,"5min":0.747,"15min":0.747},"last":0.437},{"interface":"front","average":{"1min":1.1339999999999999,"5min":0.622,"15min":0.53600000000000003},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":12.603999999999999,"5min":12.603999999999999,"15min":12.603999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.38300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.65100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.496},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.628}]},{"osd":3,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64800000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Sep 17 00:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60099999999999998,"5min":0.627,"15min":0.627},"last":0.45000000000000001}]},{"osd":6,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.46500000000000002,"15min":0.46100000000000002},"min":{"1min":0.33200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.53100000000000003}]},{"osd":7,"last update":"Tue Sep 17 00:57:36 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T00:58:26.089 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T00:58:26.089 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T00:58:26.089 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T00:58:26.089 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T00:58:26.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:25 smithi135 ceph-mon[24697]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:26.326 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T00:58:26.384 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T00:58:26.026Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003782162s 2024-09-17T00:58:26.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:58:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:27.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-mon[23769]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:27.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:27.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:27.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-mon[28615]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:27.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:27.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:26 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:27.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:26 smithi135 ceph-mon[24697]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:27.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:26 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:27.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:26 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:28.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:27 smithi071 ceph-mon[23769]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:28.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:27 smithi071 ceph-mon[28615]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:28.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:27 smithi135 ceph-mon[24697]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-17T00:58:29.693 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T00:58:29.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:29 smithi071 ceph-mon[23769]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:29.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:29 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3297729308' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T00:58:29.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:29 smithi071 ceph-mon[28615]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:29.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:29 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3297729308' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T00:58:30.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:29 smithi135 ceph-mon[24697]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:30.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:29 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3297729308' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T00:58:30.506 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T00:58:30.506 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T00:58:30.506 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:58:30.516 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-17T00:58:30.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-09-17T00:58:30.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:58:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:58:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:58:31.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:58:31] "GET /metrics HTTP/1.1" 200 191508 "" "Prometheus/2.33.4" 2024-09-17T00:58:32.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:31 smithi071 ceph-mon[28615]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:32.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:31 smithi071 ceph-mon[23769]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:32.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:31 smithi135 ceph-mon[24697]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:33.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[23769]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:33.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' 2024-09-17T00:58:33.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:33.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:33.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:33.851 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[28615]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:33.851 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' 2024-09-17T00:58:33.851 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:33.851 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:33.851 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:33.874 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:58:33.883 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-17T00:58:33.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-09-17T00:58:34.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:33 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:58:33] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:34.150 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:33 smithi135 ceph-mon[24697]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:34.150 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:33 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' 2024-09-17T00:58:34.150 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:33 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:34.150 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:33 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:34.150 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:33 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:34.882 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:58:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[23769]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[28615]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:35.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:34 smithi135 ceph-mon[24697]: pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:35.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:35.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:37.020 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T00:58:37.020 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "2b72ded0-06d6-4678-9f84-dea3d1f02f30", 2024-09-17T00:58:37.020 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "r", 2024-09-17T00:58:37.021 INFO:teuthology.orchestra.run.smithi071.stdout: "current_period": "d98c15d0-2128-4fe2-b212-4d96e7eb2d67", 2024-09-17T00:58:37.021 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1 2024-09-17T00:58:37.021 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T00:58:37.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[28615]: osdmap e59: 8 total, 8 up, 8 in 2024-09-17T00:58:37.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/583864028' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T00:58:37.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T00:58:37.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[28615]: pgmap v56: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:37.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[23769]: osdmap e59: 8 total, 8 up, 8 in 2024-09-17T00:58:37.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/583864028' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T00:58:37.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T00:58:37.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:36 smithi071 ceph-mon[23769]: pgmap v56: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:36 smithi135 ceph-mon[24697]: osdmap e59: 8 total, 8 up, 8 in 2024-09-17T00:58:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:36 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/583864028' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T00:58:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:36 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T00:58:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:36 smithi135 ceph-mon[24697]: pgmap v56: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:58:38.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:37 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T00:58:38.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:37 smithi071 ceph-mon[28615]: osdmap e60: 8 total, 8 up, 8 in 2024-09-17T00:58:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:37 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T00:58:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:37 smithi071 ceph-mon[23769]: osdmap e60: 8 total, 8 up, 8 in 2024-09-17T00:58:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:37 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T00:58:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:37 smithi135 ceph-mon[24697]: osdmap e60: 8 total, 8 up, 8 in 2024-09-17T00:58:38.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-09-17T00:58:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:38 smithi071 ceph-mon[23769]: pgmap v58: 33 pgs: 26 unknown, 7 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 383 B/s wr, 0 op/s 2024-09-17T00:58:39.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:38 smithi071 ceph-mon[23769]: osdmap e61: 8 total, 8 up, 8 in 2024-09-17T00:58:39.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:38 smithi071 ceph-mon[28615]: pgmap v58: 33 pgs: 26 unknown, 7 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 383 B/s wr, 0 op/s 2024-09-17T00:58:39.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:38 smithi071 ceph-mon[28615]: osdmap e61: 8 total, 8 up, 8 in 2024-09-17T00:58:39.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:38 smithi135 ceph-mon[24697]: pgmap v58: 33 pgs: 26 unknown, 7 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 383 B/s wr, 0 op/s 2024-09-17T00:58:39.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:38 smithi135 ceph-mon[24697]: osdmap e61: 8 total, 8 up, 8 in 2024-09-17T00:58:40.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:58:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:58:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:58:41.226 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T00:58:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "9789e078-ea61-4101-98dd-a3a781a6cbc0", 2024-09-17T00:58:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default", 2024-09-17T00:58:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "api_name": "default", 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "is_master": "true", 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "endpoints": [], 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "hostnames": [], 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "hostnames_s3website": [], 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "master_zone": "", 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "zones": [], 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_targets": [], 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "realm_id": "2b72ded0-06d6-4678-9f84-dea3d1f02f30", 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_policy": { 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "groups": [] 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:41.227 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T00:58:41.228 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:41 smithi071 ceph-mon[23769]: pgmap v60: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-17T00:58:41.228 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:58:41] "GET /metrics HTTP/1.1" 200 192565 "" "Prometheus/2.33.4" 2024-09-17T00:58:41.228 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:41 smithi071 ceph-mon[28615]: pgmap v60: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-17T00:58:41.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:41 smithi135 ceph-mon[24697]: pgmap v60: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-17T00:58:41.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-09-17T00:58:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:43 smithi135 ceph-mon[24697]: pgmap v61: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-17T00:58:43.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:43 smithi071 ceph-mon[23769]: pgmap v61: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-17T00:58:43.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:43 smithi071 ceph-mon[28615]: pgmap v61: 33 pgs: 33 active+clean; 577 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-09-17T00:58:43.949 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T00:58:43.949 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "c955f620-e6ef-4ee8-96ea-493314b97758", 2024-09-17T00:58:43.949 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "z", 2024-09-17T00:58:43.949 INFO:teuthology.orchestra.run.smithi071.stdout: "domain_root": "z.rgw.meta:root", 2024-09-17T00:58:43.949 INFO:teuthology.orchestra.run.smithi071.stdout: "control_pool": "z.rgw.control", 2024-09-17T00:58:43.949 INFO:teuthology.orchestra.run.smithi071.stdout: "gc_pool": "z.rgw.log:gc", 2024-09-17T00:58:43.949 INFO:teuthology.orchestra.run.smithi071.stdout: "lc_pool": "z.rgw.log:lc", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "log_pool": "z.rgw.log", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "roles_pool": "z.rgw.meta:roles", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "otp_pool": "z.rgw.otp", 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "system_key": { 2024-09-17T00:58:43.950 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "", 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "" 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_pools": [ 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "default-placement", 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "val": { 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "index_pool": "z.rgw.buckets.index", 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "storage_classes": { 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "STANDARD": { 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "data_pool": "z.rgw.buckets.data" 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: "index_type": 0 2024-09-17T00:58:43.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:43.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:43.952 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T00:58:43.952 INFO:teuthology.orchestra.run.smithi071.stdout: "realm_id": "2b72ded0-06d6-4678-9f84-dea3d1f02f30", 2024-09-17T00:58:43.952 INFO:teuthology.orchestra.run.smithi071.stdout: "notif_pool": "z.rgw.log:notif" 2024-09-17T00:58:43.952 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T00:58:44.692 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-09-17T00:58:45.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:45 smithi135 ceph-mon[24697]: pgmap v62: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-17T00:58:46.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:45 smithi071 ceph-mon[28615]: pgmap v62: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-17T00:58:46.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:45 smithi071 ceph-mon[23769]: pgmap v62: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-17T00:58:46.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:58:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:47 smithi071 ceph-mon[23769]: pgmap v63: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 454 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-09-17T00:58:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:47 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:47 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:47 smithi071 ceph-mon[28615]: pgmap v63: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 454 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-09-17T00:58:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:47 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:47 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:47.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:47 smithi135 ceph-mon[24697]: pgmap v63: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 454 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-09-17T00:58:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:47 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:47 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:48.797 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:48 smithi071 ceph-mon[28615]: osdmap e62: 8 total, 8 up, 8 in 2024-09-17T00:58:48.797 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:48 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-17T00:58:48.797 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:48 smithi071 ceph-mon[23769]: osdmap e62: 8 total, 8 up, 8 in 2024-09-17T00:58:48.798 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:48 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-17T00:58:48.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:48 smithi135 ceph-mon[24697]: osdmap e62: 8 total, 8 up, 8 in 2024-09-17T00:58:48.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:48 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-17T00:58:49.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:49 smithi135 ceph-mon[24697]: pgmap v65: 65 pgs: 3 creating+peering, 33 active+clean, 29 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 409 B/s wr, 1 op/s 2024-09-17T00:58:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:49 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-17T00:58:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:49 smithi135 ceph-mon[24697]: osdmap e63: 8 total, 8 up, 8 in 2024-09-17T00:58:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:49 smithi071 ceph-mon[23769]: pgmap v65: 65 pgs: 3 creating+peering, 33 active+clean, 29 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 409 B/s wr, 1 op/s 2024-09-17T00:58:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:49 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-17T00:58:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:49 smithi071 ceph-mon[23769]: osdmap e63: 8 total, 8 up, 8 in 2024-09-17T00:58:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:49 smithi071 ceph-mon[28615]: pgmap v65: 65 pgs: 3 creating+peering, 33 active+clean, 29 unknown; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 409 B/s wr, 1 op/s 2024-09-17T00:58:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:49 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-17T00:58:49.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:49 smithi071 ceph-mon[28615]: osdmap e63: 8 total, 8 up, 8 in 2024-09-17T00:58:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:50 smithi071 ceph-mon[23769]: osdmap e64: 8 total, 8 up, 8 in 2024-09-17T00:58:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:50 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-17T00:58:50.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:50 smithi071 ceph-mon[28615]: osdmap e64: 8 total, 8 up, 8 in 2024-09-17T00:58:50.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:50 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-17T00:58:50.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:50 smithi135 ceph-mon[24697]: osdmap e64: 8 total, 8 up, 8 in 2024-09-17T00:58:50.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:50 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-17T00:58:50.923 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:58:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:58:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:58:51.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:58:51] "GET /metrics HTTP/1.1" 200 192565 "" "Prometheus/2.33.4" 2024-09-17T00:58:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:51 smithi135 ceph-mon[24697]: pgmap v68: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-17T00:58:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:51 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-17T00:58:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:51 smithi135 ceph-mon[24697]: osdmap e65: 8 total, 8 up, 8 in 2024-09-17T00:58:51.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-mon[23769]: pgmap v68: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-17T00:58:51.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-17T00:58:51.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-mon[23769]: osdmap e65: 8 total, 8 up, 8 in 2024-09-17T00:58:51.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:58:51] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:58:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-mon[28615]: pgmap v68: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-17T00:58:51.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4019182632' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-17T00:58:51.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:51 smithi071 ceph-mon[28615]: osdmap e65: 8 total, 8 up, 8 in 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: osdmap e66: 8 total, 8 up, 8 in 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:52.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[23769]: osdmap e67: 8 total, 8 up, 8 in 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: osdmap e66: 8 total, 8 up, 8 in 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:52.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-17T00:58:52.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:52 smithi071 ceph-mon[28615]: osdmap e67: 8 total, 8 up, 8 in 2024-09-17T00:58:52.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: osdmap e66: 8 total, 8 up, 8 in 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-17T00:58:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:52 smithi135 ceph-mon[24697]: osdmap e67: 8 total, 8 up, 8 in 2024-09-17T00:58:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[23769]: pgmap v71: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T00:58:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T00:58:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T00:58:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[23769]: osdmap e68: 8 total, 8 up, 8 in 2024-09-17T00:58:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-09-17T00:58:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[28615]: pgmap v71: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T00:58:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T00:58:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T00:58:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[28615]: osdmap e68: 8 total, 8 up, 8 in 2024-09-17T00:58:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:53 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-09-17T00:58:53.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:53 smithi135 ceph-mon[24697]: pgmap v71: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T00:58:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:53 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T00:58:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:53 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T00:58:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:53 smithi135 ceph-mon[24697]: osdmap e68: 8 total, 8 up, 8 in 2024-09-17T00:58:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:53 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-09-17T00:58:54.571 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T00:58:54.571 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "83f4d1ae-2a01-4bb7-afa3-20909679618c", 2024-09-17T00:58:54.571 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-09-17T00:58:54.571 INFO:teuthology.orchestra.run.smithi071.stdout: "predecessor_uuid": "d98c15d0-2128-4fe2-b212-4d96e7eb2d67", 2024-09-17T00:58:54.571 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_status": [], 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "period_map": { 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "83f4d1ae-2a01-4bb7-afa3-20909679618c", 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "zonegroups": [ 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "9789e078-ea61-4101-98dd-a3a781a6cbc0", 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default", 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "api_name": "default", 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "is_master": "true", 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "endpoints": [], 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "hostnames": [], 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "hostnames_s3website": [], 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "master_zone": "c955f620-e6ef-4ee8-96ea-493314b97758", 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: "zones": [ 2024-09-17T00:58:54.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "c955f620-e6ef-4ee8-96ea-493314b97758", 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "z", 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "endpoints": [], 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "log_meta": "false", 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "log_data": "false", 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_index_max_shards": 11, 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "read_only": "false", 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_type": "", 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_from_all": "true", 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_from": [], 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "redirect_zone": "" 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T00:58:54.573 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_targets": [ 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "default-placement", 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "storage_classes": [ 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "STANDARD" 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "default-placement", 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "realm_id": "2b72ded0-06d6-4678-9f84-dea3d1f02f30", 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_policy": { 2024-09-17T00:58:54.574 INFO:teuthology.orchestra.run.smithi071.stdout: "groups": [] 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: "short_zone_ids": [ 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "c955f620-e6ef-4ee8-96ea-493314b97758", 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 429080617 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: "master_zonegroup": "9789e078-ea61-4101-98dd-a3a781a6cbc0", 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: "master_zone": "c955f620-e6ef-4ee8-96ea-493314b97758", 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: "period_config": { 2024-09-17T00:58:54.575 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-17T00:58:54.576 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "user_ratelimit": { 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_read_ops": 0, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_write_ops": 0, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_read_bytes": 0, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_write_bytes": 0, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_ratelimit": { 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_read_ops": 0, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_write_ops": 0, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_read_bytes": 0, 2024-09-17T00:58:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: "max_write_bytes": 0, 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "anonymous_ratelimit": { 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "max_read_ops": 0, 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "max_write_ops": 0, 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "max_read_bytes": 0, 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "max_write_bytes": 0, 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T00:58:54.578 INFO:teuthology.orchestra.run.smithi071.stdout: "realm_id": "2b72ded0-06d6-4678-9f84-dea3d1f02f30", 2024-09-17T00:58:54.579 INFO:teuthology.orchestra.run.smithi071.stdout: "realm_name": "r", 2024-09-17T00:58:54.579 INFO:teuthology.orchestra.run.smithi071.stdout: "realm_epoch": 2 2024-09-17T00:58:54.579 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T00:58:55.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000' 2024-09-17T00:58:55.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:55 smithi071 ceph-mon[28615]: pgmap v74: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-09-17T00:58:55.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:55 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-09-17T00:58:55.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:55 smithi071 ceph-mon[28615]: osdmap e69: 8 total, 8 up, 8 in 2024-09-17T00:58:55.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:55 smithi071 ceph-mon[23769]: pgmap v74: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-09-17T00:58:55.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:55 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-09-17T00:58:55.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:55 smithi071 ceph-mon[23769]: osdmap e69: 8 total, 8 up, 8 in 2024-09-17T00:58:55.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:55 smithi135 ceph-mon[24697]: pgmap v74: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-09-17T00:58:55.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:55 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4146524287' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-09-17T00:58:55.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:55 smithi135 ceph-mon[24697]: osdmap e69: 8 total, 8 up, 8 in 2024-09-17T00:58:57.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:57 smithi071 ceph-mon[23769]: pgmap v76: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 228 B/s rd, 456 B/s wr, 1 op/s 2024-09-17T00:58:57.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:57 smithi071 ceph-mon[28615]: pgmap v76: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 228 B/s rd, 456 B/s wr, 1 op/s 2024-09-17T00:58:57.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:57 smithi135 ceph-mon[24697]: pgmap v76: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 228 B/s rd, 456 B/s wr, 1 op/s 2024-09-17T00:58:58.991 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled rgw.foo update... 2024-09-17T00:59:00.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: pgmap v77: 129 pgs: 129 active+clean; 580 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 682 B/s wr, 1 op/s 2024-09-17T00:59:00.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:00.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:00.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: pgmap v77: 129 pgs: 129 active+clean; 580 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 682 B/s wr, 1 op/s 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:00.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:58:59 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: pgmap v77: 129 pgs: 129 active+clean; 580 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 682 B/s wr, 1 op/s 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:58:59 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:00.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch apply rgw smpl' 2024-09-17T00:59:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[23769]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[23769]: Saving service rgw.foo spec with placement count:2 2024-09-17T00:59:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[23769]: Saving service rgw.foo spec with placement count:2 2024-09-17T00:59:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[23769]: Deploying daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T00:59:00.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[28615]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:00.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[28615]: Saving service rgw.foo spec with placement count:2 2024-09-17T00:59:00.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[28615]: Saving service rgw.foo spec with placement count:2 2024-09-17T00:59:00.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:00 smithi071 ceph-mon[28615]: Deploying daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T00:59:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:00 smithi135 ceph-mon[24697]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:00 smithi135 ceph-mon[24697]: Saving service rgw.foo spec with placement count:2 2024-09-17T00:59:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:00 smithi135 ceph-mon[24697]: Saving service rgw.foo spec with placement count:2 2024-09-17T00:59:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:00 smithi135 ceph-mon[24697]: Deploying daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T00:59:00.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:59:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:59:01.264 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:01] "GET /metrics HTTP/1.1" 200 196369 "" "Prometheus/2.33.4" 2024-09-17T00:59:01.893 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:01 smithi071 ceph-mon[23769]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T00:59:01.893 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:01 smithi071 ceph-mon[28615]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T00:59:02.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:01 smithi135 ceph-mon[24697]: pgmap v78: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-17T00:59:03.429 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled rgw.smpl update... 2024-09-17T00:59:04.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:03 smithi071 ceph-mon[23769]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 845 B/s rd, 845 B/s wr, 2 op/s 2024-09-17T00:59:04.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:03 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:03 smithi071 ceph-mon[28615]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 845 B/s rd, 845 B/s wr, 2 op/s 2024-09-17T00:59:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:03 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:03 smithi135 ceph-mon[24697]: pgmap v79: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 845 B/s rd, 845 B/s wr, 2 op/s 2024-09-17T00:59:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:03 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:04.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph osd pool create foo' 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: Saving service rgw.smpl spec with placement count:2 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:04 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: Saving service rgw.smpl spec with placement count:2 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "smpl", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: Saving service rgw.smpl spec with placement count:2 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:04 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:05 smithi071 ceph-mon[23769]: pgmap v80: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 716 B/s wr, 1 op/s 2024-09-17T00:59:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:05 smithi071 ceph-mon[23769]: Deploying daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T00:59:05.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:05 smithi071 ceph-mon[28615]: pgmap v80: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 716 B/s wr, 1 op/s 2024-09-17T00:59:05.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:05 smithi071 ceph-mon[28615]: Deploying daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T00:59:05.938 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:05 smithi135 ceph-mon[24697]: pgmap v80: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 716 B/s wr, 1 op/s 2024-09-17T00:59:05.938 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:05 smithi135 ceph-mon[24697]: Deploying daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T00:59:06.788 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'foo' created 2024-09-17T00:59:06.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:06 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1916924006' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-17T00:59:06.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:06 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:06.800 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:06 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:06.895 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:06 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:06 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1916924006' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-17T00:59:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:06 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:06 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:06 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1916924006' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-17T00:59:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:06 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:06 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'rbd pool init foo' 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: pgmap v81: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 624 B/s rd, 624 B/s wr, 1 op/s 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1916924006' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: osdmap e70: 8 total, 8 up, 8 in 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: pgmap v81: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 624 B/s rd, 624 B/s wr, 1 op/s 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1916924006' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: osdmap e70: 8 total, 8 up, 8 in 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:07.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:07.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:07 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: pgmap v81: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 624 B/s rd, 624 B/s wr, 1 op/s 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1916924006' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: osdmap e70: 8 total, 8 up, 8 in 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:07.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:07.922 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:07 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: pgmap v83: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 457 B/s rd, 571 B/s wr, 1 op/s 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: pgmap v84: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: pgmap v85: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:08.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: osdmap e71: 8 total, 8 up, 8 in 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[23769]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: pgmap v83: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 457 B/s rd, 571 B/s wr, 1 op/s 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: pgmap v84: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: pgmap v85: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: osdmap e71: 8 total, 8 up, 8 in 2024-09-17T00:59:08.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:08 smithi071 ceph-mon[28615]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:59:08.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: pgmap v83: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 457 B/s rd, 571 B/s wr, 1 op/s 2024-09-17T00:59:08.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:08.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:08.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: pgmap v84: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:08.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: pgmap v85: 161 pgs: 32 unknown, 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:08.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:08.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:08.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: osdmap e71: 8 total, 8 up, 8 in 2024-09-17T00:59:08.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:08 smithi135 ceph-mon[24697]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-17T00:59:10.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:09 smithi071 ceph-mon[23769]: osdmap e72: 8 total, 8 up, 8 in 2024-09-17T00:59:10.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:09 smithi071 ceph-mon[28615]: osdmap e72: 8 total, 8 up, 8 in 2024-09-17T00:59:10.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:09 smithi135 ceph-mon[24697]: osdmap e72: 8 total, 8 up, 8 in 2024-09-17T00:59:10.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:10 smithi135 ceph-mon[24697]: pgmap v88: 161 pgs: 10 creating+activating, 151 active+clean; 585 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 707 KiB/s rd, 14 KiB/s wr, 1.24k op/s 2024-09-17T00:59:10.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:59:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:59:11.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:10 smithi071 ceph-mon[23769]: pgmap v88: 161 pgs: 10 creating+activating, 151 active+clean; 585 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 707 KiB/s rd, 14 KiB/s wr, 1.24k op/s 2024-09-17T00:59:11.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:10 smithi071 ceph-mon[28615]: pgmap v88: 161 pgs: 10 creating+activating, 151 active+clean; 585 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 707 KiB/s rd, 14 KiB/s wr, 1.24k op/s 2024-09-17T00:59:11.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:11] "GET /metrics HTTP/1.1" 200 206258 "" "Prometheus/2.33.4" 2024-09-17T00:59:11.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:59:11] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:12.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3625656882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-17T00:59:12.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-17T00:59:12.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:12.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3625656882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-17T00:59:12.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-17T00:59:12.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:11 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:12.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:11 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3625656882' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-17T00:59:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:11 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-17T00:59:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:11 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:13.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:12 smithi135 ceph-mon[24697]: pgmap v89: 161 pgs: 10 creating+activating, 151 active+clean; 585 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 414 KiB/s rd, 8.2 KiB/s wr, 726 op/s 2024-09-17T00:59:13.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:12 smithi135 ceph-mon[24697]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-17T00:59:13.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:12 smithi135 ceph-mon[24697]: osdmap e73: 8 total, 8 up, 8 in 2024-09-17T00:59:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:12 smithi071 ceph-mon[23769]: pgmap v89: 161 pgs: 10 creating+activating, 151 active+clean; 585 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 414 KiB/s rd, 8.2 KiB/s wr, 726 op/s 2024-09-17T00:59:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:12 smithi071 ceph-mon[23769]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-17T00:59:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:12 smithi071 ceph-mon[23769]: osdmap e73: 8 total, 8 up, 8 in 2024-09-17T00:59:13.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:12] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:12 smithi071 ceph-mon[28615]: pgmap v89: 161 pgs: 10 creating+activating, 151 active+clean; 585 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 414 KiB/s rd, 8.2 KiB/s wr, 726 op/s 2024-09-17T00:59:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:12 smithi071 ceph-mon[28615]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-17T00:59:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:12 smithi071 ceph-mon[28615]: osdmap e73: 8 total, 8 up, 8 in 2024-09-17T00:59:13.822 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:59:13] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[28615]: osdmap e74: 8 total, 8 up, 8 in 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[23769]: osdmap e74: 8 total, 8 up, 8 in 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:13 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:13 smithi135 ceph-mon[24697]: osdmap e74: 8 total, 8 up, 8 in 2024-09-17T00:59:14.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:13 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:13 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:13 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:14.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:14 smithi071 ceph-mon[23769]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 345 KiB/s rd, 6.6 KiB/s wr, 601 op/s 2024-09-17T00:59:14.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:14 smithi071 ceph-mon[23769]: osdmap e75: 8 total, 8 up, 8 in 2024-09-17T00:59:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:14 smithi071 ceph-mon[28615]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 345 KiB/s rd, 6.6 KiB/s wr, 601 op/s 2024-09-17T00:59:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:14 smithi071 ceph-mon[28615]: osdmap e75: 8 total, 8 up, 8 in 2024-09-17T00:59:15.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch apply iscsi foo u p' 2024-09-17T00:59:15.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:14 smithi135 ceph-mon[24697]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 345 KiB/s rd, 6.6 KiB/s wr, 601 op/s 2024-09-17T00:59:15.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:14 smithi135 ceph-mon[24697]: osdmap e75: 8 total, 8 up, 8 in 2024-09-17T00:59:16.058 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:17.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 170 B/s wr, 25 op/s 2024-09-17T00:59:17.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:17.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 231 B/s wr, 34 op/s 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: Saving service rgw.smpl spec with placement count:2 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: Deploying daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:59:17.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[23769]: Cluster is now healthy 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 170 B/s wr, 25 op/s 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 231 B/s wr, 34 op/s 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: Saving service rgw.smpl spec with placement count:2 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:17.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:17.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:17.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:17.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: Deploying daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T00:59:17.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:59:17.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:16 smithi071 ceph-mon[28615]: Cluster is now healthy 2024-09-17T00:59:17.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 170 B/s wr, 25 op/s 2024-09-17T00:59:17.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:17.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 231 B/s wr, 34 op/s 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: Saving service rgw.smpl spec with placement count:2 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: Deploying daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-17T00:59:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:16 smithi135 ceph-mon[24697]: Cluster is now healthy 2024-09-17T00:59:17.570 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled iscsi.foo update... 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[23769]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[23769]: Saving service iscsi.foo spec with placement count:1 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[23769]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 171 B/s wr, 25 op/s 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[28615]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[28615]: Saving service iscsi.foo spec with placement count:1 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:18.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:18 smithi071 ceph-mon[28615]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 171 B/s wr, 25 op/s 2024-09-17T00:59:18.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'sleep 120' 2024-09-17T00:59:18.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:18 smithi135 ceph-mon[24697]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:18 smithi135 ceph-mon[24697]: Saving service iscsi.foo spec with placement count:1 2024-09-17T00:59:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:18 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:18 smithi135 ceph-mon[24697]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 171 B/s wr, 25 op/s 2024-09-17T00:59:20.951 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:20 smithi071 ceph-mon[28615]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 294 B/s wr, 21 op/s 2024-09-17T00:59:20.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:20 smithi071 ceph-mon[23769]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 294 B/s wr, 21 op/s 2024-09-17T00:59:20.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:20 smithi135 ceph-mon[24697]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 294 B/s wr, 21 op/s 2024-09-17T00:59:20.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:59:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:59:21.215 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:21] "GET /metrics HTTP/1.1" 200 206258 "" "Prometheus/2.33.4" 2024-09-17T00:59:23.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 121 B/s wr, 0 op/s 2024-09-17T00:59:23.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:23.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:23.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:23.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:23.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:23.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:23.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[28615]: Deploying daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 121 B/s wr, 0 op/s 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:23.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:22 smithi071 ceph-mon[23769]: Deploying daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T00:59:23.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 121 B/s wr, 0 op/s 2024-09-17T00:59:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T00:59:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T00:59:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:22 smithi135 ceph-mon[24697]: Deploying daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: osdmap e76: 8 total, 8 up, 8 in 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s rd, 243 B/s wr, 188 op/s 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:25.008 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: osdmap e76: 8 total, 8 up, 8 in 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s rd, 243 B/s wr, 188 op/s 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:25.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:24 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:25.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: osdmap e76: 8 total, 8 up, 8 in 2024-09-17T00:59:25.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s rd, 243 B/s wr, 188 op/s 2024-09-17T00:59:25.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:25.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:25.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:25.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:25.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:25.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:24 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:26.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[28615]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:26.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:26.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[28615]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:26.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:26.031 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[23769]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:26.031 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:26.031 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[23769]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:26.032 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:25 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:26.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:25 smithi135 ceph-mon[24697]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:26.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:26.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:25 smithi135 ceph-mon[24697]: Checking dashboard <-> RGW credentials 2024-09-17T00:59:26.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:25 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:27.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:27.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:26 smithi135 ceph-mon[24697]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 204 B/s wr, 158 op/s 2024-09-17T00:59:27.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:26 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:27.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:26 smithi071 ceph-mon[28615]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 204 B/s wr, 158 op/s 2024-09-17T00:59:27.093 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:26 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:27.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:26 smithi071 ceph-mon[23769]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 204 B/s wr, 158 op/s 2024-09-17T00:59:28.268 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:28 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:28.268 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:28 smithi135 ceph-mon[24697]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 204 B/s wr, 158 op/s 2024-09-17T00:59:28.359 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:28 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:28.359 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:28 smithi071 ceph-mon[23769]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 204 B/s wr, 158 op/s 2024-09-17T00:59:28.360 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:28 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:28.360 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:28 smithi071 ceph-mon[28615]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 91 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 204 B/s wr, 158 op/s 2024-09-17T00:59:28.360 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:28.360 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:59:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:29.395 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:29 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:29.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:29 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:29.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:29 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:29.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:29 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:29.458 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:29 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:29.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:29 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:30.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-mon[23769]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 195 KiB/s rd, 204 B/s wr, 294 op/s 2024-09-17T00:59:30.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:30.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:30.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:30.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-mon[28615]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 195 KiB/s rd, 204 B/s wr, 294 op/s 2024-09-17T00:59:30.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:30.428 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:30 smithi135 ceph-mon[24697]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 195 KiB/s rd, 204 B/s wr, 294 op/s 2024-09-17T00:59:30.428 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:30 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:30.428 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:30 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:30.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:59:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:59:31.124 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:30 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:59:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:31.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:31] "GET /metrics HTTP/1.1" 200 210741 "" "Prometheus/2.33.4" 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: Checking pool "foo" exists for service iscsi.foo 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T00:59:32.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[23769]: Deploying daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: Checking pool "foo" exists for service iscsi.foo 2024-09-17T00:59:32.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T00:59:32.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T00:59:32.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-17T00:59:32.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:32.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:31 smithi071 ceph-mon[28615]: Deploying daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: Checking pool "foo" exists for service iscsi.foo 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-17T00:59:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:31 smithi135 ceph-mon[24697]: Deploying daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T00:59:33.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:32 smithi071 ceph-mon[23769]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 195 KiB/s rd, 204 B/s wr, 294 op/s 2024-09-17T00:59:33.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:32 smithi071 ceph-mon[28615]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 195 KiB/s rd, 204 B/s wr, 294 op/s 2024-09-17T00:59:33.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:32 smithi135 ceph-mon[24697]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 195 KiB/s rd, 204 B/s wr, 294 op/s 2024-09-17T00:59:34.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:33 smithi071 ceph-mon[23769]: mgrmap e20: y(active, since 2m), standbys: x 2024-09-17T00:59:34.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:33 smithi071 ceph-mon[28615]: mgrmap e20: y(active, since 2m), standbys: x 2024-09-17T00:59:34.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:33 smithi135 ceph-mon[24697]: mgrmap e20: y(active, since 2m), standbys: x 2024-09-17T00:59:35.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 102 B/s wr, 158 op/s 2024-09-17T00:59:35.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:35.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:35.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T00:59:35.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T00:59:35.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T00:59:35.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:35.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:35.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1190852816' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T00:59:35.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2908815669' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3941349606"}]: dispatch 2024-09-17T00:59:35.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 102 B/s wr, 158 op/s 2024-09-17T00:59:35.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:35.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:35.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T00:59:35.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T00:59:35.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T00:59:35.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:35.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:35.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1190852816' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T00:59:35.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:34 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2908815669' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3941349606"}]: dispatch 2024-09-17T00:59:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 102 B/s wr, 158 op/s 2024-09-17T00:59:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1190852816' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T00:59:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:34 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2908815669' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3941349606"}]: dispatch 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: Adding iSCSI gateway http://:@172.21.15.71:5000 to Dashboard 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2908815669' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3941349606"}]': finished 2024-09-17T00:59:35.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: osdmap e77: 8 total, 8 up, 8 in 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2875846926' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]: dispatch 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]: dispatch 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: Adding iSCSI gateway http://:@172.21.15.71:5000 to Dashboard 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2908815669' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3941349606"}]': finished 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: osdmap e77: 8 total, 8 up, 8 in 2024-09-17T00:59:35.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2875846926' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]: dispatch 2024-09-17T00:59:35.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:35 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]: dispatch 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: Adding iSCSI gateway http://:@172.21.15.71:5000 to Dashboard 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2908815669' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3941349606"}]': finished 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: osdmap e77: 8 total, 8 up, 8 in 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2875846926' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]: dispatch 2024-09-17T00:59:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:35 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]: dispatch 2024-09-17T00:59:36.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[23769]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 102 B/s wr, 158 op/s 2024-09-17T00:59:36.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]': finished 2024-09-17T00:59:36.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[23769]: osdmap e78: 8 total, 8 up, 8 in 2024-09-17T00:59:36.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1231449287' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3623700348"}]: dispatch 2024-09-17T00:59:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[28615]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 102 B/s wr, 158 op/s 2024-09-17T00:59:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]': finished 2024-09-17T00:59:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[28615]: osdmap e78: 8 total, 8 up, 8 in 2024-09-17T00:59:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:36 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1231449287' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3623700348"}]: dispatch 2024-09-17T00:59:37.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:36 smithi135 ceph-mon[24697]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s rd, 102 B/s wr, 158 op/s 2024-09-17T00:59:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:36 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3941349606"}]': finished 2024-09-17T00:59:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:36 smithi135 ceph-mon[24697]: osdmap e78: 8 total, 8 up, 8 in 2024-09-17T00:59:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:36 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1231449287' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3623700348"}]: dispatch 2024-09-17T00:59:38.065 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:37 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1231449287' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3623700348"}]': finished 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[23769]: osdmap e79: 8 total, 8 up, 8 in 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/101676907' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]: dispatch 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]: dispatch 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[23769]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 36 op/s 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:38.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1231449287' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3623700348"}]': finished 2024-09-17T00:59:38.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[28615]: osdmap e79: 8 total, 8 up, 8 in 2024-09-17T00:59:38.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:38.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/101676907' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]: dispatch 2024-09-17T00:59:38.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]: dispatch 2024-09-17T00:59:38.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[28615]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 36 op/s 2024-09-17T00:59:38.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:38 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:38 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1231449287' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3623700348"}]': finished 2024-09-17T00:59:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:38 smithi135 ceph-mon[24697]: osdmap e79: 8 total, 8 up, 8 in 2024-09-17T00:59:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:38 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:38 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/101676907' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]: dispatch 2024-09-17T00:59:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:38 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]: dispatch 2024-09-17T00:59:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:38 smithi135 ceph-mon[24697]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 25 KiB/s rd, 0 B/s wr, 36 op/s 2024-09-17T00:59:38.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:38 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:39.348 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]': finished 2024-09-17T00:59:39.349 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[28615]: osdmap e80: 8 total, 8 up, 8 in 2024-09-17T00:59:39.349 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4050737534' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]: dispatch 2024-09-17T00:59:39.349 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]: dispatch 2024-09-17T00:59:39.349 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]': finished 2024-09-17T00:59:39.349 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[23769]: osdmap e80: 8 total, 8 up, 8 in 2024-09-17T00:59:39.349 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4050737534' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]: dispatch 2024-09-17T00:59:39.349 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:39 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]: dispatch 2024-09-17T00:59:39.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:39 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/653059959"}]': finished 2024-09-17T00:59:39.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:39 smithi135 ceph-mon[24697]: osdmap e80: 8 total, 8 up, 8 in 2024-09-17T00:59:39.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:39 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4050737534' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]: dispatch 2024-09-17T00:59:39.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:39 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]: dispatch 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]': finished 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[23769]: osdmap e81: 8 total, 8 up, 8 in 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2457765923' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]: dispatch 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]: dispatch 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[23769]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 255 B/s wr, 18 op/s 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]': finished 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[28615]: osdmap e81: 8 total, 8 up, 8 in 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2457765923' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]: dispatch 2024-09-17T00:59:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]: dispatch 2024-09-17T00:59:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-mon[28615]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 255 B/s wr, 18 op/s 2024-09-17T00:59:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:40 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1610062920"}]': finished 2024-09-17T00:59:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:40 smithi135 ceph-mon[24697]: osdmap e81: 8 total, 8 up, 8 in 2024-09-17T00:59:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:40 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2457765923' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]: dispatch 2024-09-17T00:59:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:40 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]: dispatch 2024-09-17T00:59:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:40 smithi135 ceph-mon[24697]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 255 B/s wr, 18 op/s 2024-09-17T00:59:40.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:40 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:40] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:40.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:59:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:59:41.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:41] "GET /metrics HTTP/1.1" 200 214995 "" "Prometheus/2.33.4" 2024-09-17T00:59:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]': finished 2024-09-17T00:59:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: osdmap e82: 8 total, 8 up, 8 in 2024-09-17T00:59:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3977055957' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]: dispatch 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]: dispatch 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]': finished 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: osdmap e82: 8 total, 8 up, 8 in 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3977055957' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]: dispatch 2024-09-17T00:59:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]: dispatch 2024-09-17T00:59:41.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:41.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:41.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:41 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/2786955802"}]': finished 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: osdmap e82: 8 total, 8 up, 8 in 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3977055957' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]: dispatch 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]: dispatch 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:41.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:41 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:42.704 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:42 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]': finished 2024-09-17T00:59:42.704 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:42 smithi135 ceph-mon[24697]: osdmap e83: 8 total, 8 up, 8 in 2024-09-17T00:59:42.704 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:42 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1509262412' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/645001224"}]: dispatch 2024-09-17T00:59:42.704 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:42 smithi135 ceph-mon[24697]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 255 B/s wr, 18 op/s 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]': finished 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[28615]: osdmap e83: 8 total, 8 up, 8 in 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1509262412' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/645001224"}]: dispatch 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[28615]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 255 B/s wr, 18 op/s 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3232619979"}]': finished 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[23769]: osdmap e83: 8 total, 8 up, 8 in 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1509262412' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/645001224"}]: dispatch 2024-09-17T00:59:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:42 smithi071 ceph-mon[23769]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 255 B/s wr, 18 op/s 2024-09-17T00:59:43.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:43 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1509262412' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/645001224"}]': finished 2024-09-17T00:59:43.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:43 smithi135 ceph-mon[24697]: osdmap e84: 8 total, 8 up, 8 in 2024-09-17T00:59:43.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:43 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1418551318' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/372115331"}]: dispatch 2024-09-17T00:59:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:43 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1509262412' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/645001224"}]': finished 2024-09-17T00:59:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:43 smithi071 ceph-mon[28615]: osdmap e84: 8 total, 8 up, 8 in 2024-09-17T00:59:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:43 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1418551318' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/372115331"}]: dispatch 2024-09-17T00:59:43.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:43 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1509262412' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/645001224"}]': finished 2024-09-17T00:59:43.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:43 smithi071 ceph-mon[23769]: osdmap e84: 8 total, 8 up, 8 in 2024-09-17T00:59:43.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:43 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1418551318' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/372115331"}]: dispatch 2024-09-17T00:59:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:44 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1418551318' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/372115331"}]': finished 2024-09-17T00:59:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:44 smithi135 ceph-mon[24697]: osdmap e85: 8 total, 8 up, 8 in 2024-09-17T00:59:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:44 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3640486005' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]: dispatch 2024-09-17T00:59:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:44 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]: dispatch 2024-09-17T00:59:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:44 smithi135 ceph-mon[24697]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1418551318' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/372115331"}]': finished 2024-09-17T00:59:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[28615]: osdmap e85: 8 total, 8 up, 8 in 2024-09-17T00:59:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3640486005' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]: dispatch 2024-09-17T00:59:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]: dispatch 2024-09-17T00:59:44.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[28615]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:44.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1418551318' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/372115331"}]': finished 2024-09-17T00:59:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[23769]: osdmap e85: 8 total, 8 up, 8 in 2024-09-17T00:59:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3640486005' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]: dispatch 2024-09-17T00:59:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]: dispatch 2024-09-17T00:59:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:44 smithi071 ceph-mon[23769]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:45.654 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:45 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T00:59:45.654 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:45 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]': finished 2024-09-17T00:59:45.654 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:45 smithi135 ceph-mon[24697]: osdmap e86: 8 total, 8 up, 8 in 2024-09-17T00:59:45.655 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:45 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2436989376' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]: dispatch 2024-09-17T00:59:45.655 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:45 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]: dispatch 2024-09-17T00:59:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T00:59:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]': finished 2024-09-17T00:59:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[23769]: osdmap e86: 8 total, 8 up, 8 in 2024-09-17T00:59:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2436989376' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]: dispatch 2024-09-17T00:59:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]: dispatch 2024-09-17T00:59:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T00:59:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/994352927"}]': finished 2024-09-17T00:59:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[28615]: osdmap e86: 8 total, 8 up, 8 in 2024-09-17T00:59:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2436989376' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]: dispatch 2024-09-17T00:59:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:45 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]: dispatch 2024-09-17T00:59:46.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:46 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]': finished 2024-09-17T00:59:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:46 smithi135 ceph-mon[24697]: osdmap e87: 8 total, 8 up, 8 in 2024-09-17T00:59:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:46 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2972423444' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/806906688"}]: dispatch 2024-09-17T00:59:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:46 smithi135 ceph-mon[24697]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]': finished 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[23769]: osdmap e87: 8 total, 8 up, 8 in 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2972423444' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/806906688"}]: dispatch 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[23769]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/2786955802"}]': finished 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[28615]: osdmap e87: 8 total, 8 up, 8 in 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2972423444' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/806906688"}]: dispatch 2024-09-17T00:59:46.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:46 smithi071 ceph-mon[28615]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:47.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:47 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2972423444' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/806906688"}]': finished 2024-09-17T00:59:47.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:47 smithi135 ceph-mon[24697]: osdmap e88: 8 total, 8 up, 8 in 2024-09-17T00:59:47.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:47 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3398585498' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3513527777"}]: dispatch 2024-09-17T00:59:47.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:47 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:47.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:47 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:47.645 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:00:59:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2972423444' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/806906688"}]': finished 2024-09-17T00:59:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[23769]: osdmap e88: 8 total, 8 up, 8 in 2024-09-17T00:59:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3398585498' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3513527777"}]: dispatch 2024-09-17T00:59:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:47.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:47.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2972423444' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/806906688"}]': finished 2024-09-17T00:59:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[28615]: osdmap e88: 8 total, 8 up, 8 in 2024-09-17T00:59:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3398585498' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3513527777"}]: dispatch 2024-09-17T00:59:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:47.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:47 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:48 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3398585498' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3513527777"}]': finished 2024-09-17T00:59:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:48 smithi135 ceph-mon[24697]: osdmap e89: 8 total, 8 up, 8 in 2024-09-17T00:59:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:48 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1682232873' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]: dispatch 2024-09-17T00:59:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:48 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]: dispatch 2024-09-17T00:59:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:48 smithi135 ceph-mon[24697]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:48.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3398585498' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3513527777"}]': finished 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[23769]: osdmap e89: 8 total, 8 up, 8 in 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1682232873' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]: dispatch 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]: dispatch 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[23769]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3398585498' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/3513527777"}]': finished 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[28615]: osdmap e89: 8 total, 8 up, 8 in 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1682232873' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]: dispatch 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]: dispatch 2024-09-17T00:59:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:48 smithi071 ceph-mon[28615]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 94 MiB used, 715 GiB / 715 GiB avail 2024-09-17T00:59:49.778 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]': finished 2024-09-17T00:59:49.778 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[28615]: osdmap e90: 8 total, 8 up, 8 in 2024-09-17T00:59:49.778 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1623980420' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]: dispatch 2024-09-17T00:59:49.778 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]: dispatch 2024-09-17T00:59:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]': finished 2024-09-17T00:59:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[23769]: osdmap e90: 8 total, 8 up, 8 in 2024-09-17T00:59:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1623980420' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]: dispatch 2024-09-17T00:59:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:49 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]: dispatch 2024-09-17T00:59:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:49 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3673565773"}]': finished 2024-09-17T00:59:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:49 smithi135 ceph-mon[24697]: osdmap e90: 8 total, 8 up, 8 in 2024-09-17T00:59:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:49 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1623980420' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]: dispatch 2024-09-17T00:59:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:49 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]: dispatch 2024-09-17T00:59:50.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 00:59:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T00:59:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:50 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]': finished 2024-09-17T00:59:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:50 smithi135 ceph-mon[24697]: osdmap e91: 8 total, 8 up, 8 in 2024-09-17T00:59:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:50 smithi135 ceph-mon[24697]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:50 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4202569410' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3513527777"}]: dispatch 2024-09-17T00:59:51.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]': finished 2024-09-17T00:59:51.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[23769]: osdmap e91: 8 total, 8 up, 8 in 2024-09-17T00:59:51.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[23769]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:51.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4202569410' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3513527777"}]: dispatch 2024-09-17T00:59:51.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1684728898"}]': finished 2024-09-17T00:59:51.124 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[28615]: osdmap e91: 8 total, 8 up, 8 in 2024-09-17T00:59:51.124 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[28615]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:51.124 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:50 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4202569410' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3513527777"}]: dispatch 2024-09-17T00:59:51.395 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:00:59:51] "GET /metrics HTTP/1.1" 200 214995 "" "Prometheus/2.33.4" 2024-09-17T00:59:52.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:51 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4202569410' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3513527777"}]': finished 2024-09-17T00:59:52.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:51 smithi071 ceph-mon[23769]: osdmap e92: 8 total, 8 up, 8 in 2024-09-17T00:59:52.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:51 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4202569410' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3513527777"}]': finished 2024-09-17T00:59:52.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:51 smithi071 ceph-mon[28615]: osdmap e92: 8 total, 8 up, 8 in 2024-09-17T00:59:52.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:51 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4202569410' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/3513527777"}]': finished 2024-09-17T00:59:52.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:51 smithi135 ceph-mon[24697]: osdmap e92: 8 total, 8 up, 8 in 2024-09-17T00:59:53.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:53.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-09-17T00:59:53.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-09-17T00:59:53.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-17T00:59:53.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:59:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-17T00:59:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:59:53.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:59:53.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:59:53.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T00:59:54.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]': finished 2024-09-17T00:59:54.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-17T00:59:54.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-17T00:59:54.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-17T00:59:54.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[23769]: osdmap e93: 8 total, 8 up, 8 in 2024-09-17T00:59:54.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]': finished 2024-09-17T00:59:54.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-17T00:59:54.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-17T00:59:54.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-17T00:59:54.055 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:53 smithi071 ceph-mon[28615]: osdmap e93: 8 total, 8 up, 8 in 2024-09-17T00:59:54.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]': finished 2024-09-17T00:59:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-09-17T00:59:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-09-17T00:59:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:53 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-17T00:59:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:53 smithi135 ceph-mon[24697]: osdmap e93: 8 total, 8 up, 8 in 2024-09-17T00:59:54.785 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:00:59:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T00:59:55.114 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[23769]: pgmap v132: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-09-17T00:59:55.114 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[23769]: osdmap e94: 8 total, 8 up, 8 in 2024-09-17T00:59:55.115 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:55.115 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:55.115 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[28615]: pgmap v132: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-09-17T00:59:55.115 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[28615]: osdmap e94: 8 total, 8 up, 8 in 2024-09-17T00:59:55.115 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:55.115 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:54 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:54 smithi135 ceph-mon[24697]: pgmap v132: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s 2024-09-17T00:59:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:54 smithi135 ceph-mon[24697]: osdmap e94: 8 total, 8 up, 8 in 2024-09-17T00:59:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:54 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:54 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T00:59:56.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:55 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T00:59:56.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:55 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T00:59:56.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:55 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T00:59:57.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:56 smithi071 ceph-mon[23769]: pgmap v134: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T00:59:57.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:56 smithi071 ceph-mon[28615]: pgmap v134: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T00:59:57.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:56 smithi135 ceph-mon[24697]: pgmap v134: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T00:59:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 00:59:58 smithi071 ceph-mon[23769]: pgmap v135: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 730 B/s rd, 0 op/s 2024-09-17T00:59:59.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 00:59:58 smithi071 ceph-mon[28615]: pgmap v135: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 730 B/s rd, 0 op/s 2024-09-17T00:59:59.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 00:59:58 smithi135 ceph-mon[24697]: pgmap v135: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 730 B/s rd, 0 op/s 2024-09-17T01:00:00.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:00 smithi135 ceph-mon[24697]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:00 smithi135 ceph-mon[24697]: overall HEALTH_OK 2024-09-17T01:00:00.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:00:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:00:01.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:00 smithi071 ceph-mon[28615]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:01.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:00 smithi071 ceph-mon[28615]: overall HEALTH_OK 2024-09-17T01:00:01.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:00 smithi071 ceph-mon[23769]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:01.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:00 smithi071 ceph-mon[23769]: overall HEALTH_OK 2024-09-17T01:00:01.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:01] "GET /metrics HTTP/1.1" 200 215007 "" "Prometheus/2.33.4" 2024-09-17T01:00:03.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:02 smithi071 ceph-mon[23769]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:03.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:02 smithi071 ceph-mon[28615]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:03.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:02 smithi135 ceph-mon[24697]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:04 smithi071 ceph-mon[23769]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:04 smithi071 ceph-mon[28615]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:05.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:04 smithi135 ceph-mon[24697]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:05 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:05 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:06.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:05 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:06.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:06 smithi135 ceph-mon[24697]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:07.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:06 smithi071 ceph-mon[28615]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:07.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:06 smithi071 ceph-mon[23769]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:07.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:00:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:00:08.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:08 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:08.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:08 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:08.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:08 smithi135 ceph-mon[24697]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:08 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:08 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:08 smithi071 ceph-mon[23769]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:08.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:08 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:08.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:08 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:08.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:08 smithi071 ceph-mon[28615]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:10 smithi135 ceph-mon[24697]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:10.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:00:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:00:11.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:10 smithi071 ceph-mon[28615]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:11.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:10 smithi071 ceph-mon[23769]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:00:11.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:11] "GET /metrics HTTP/1.1" 200 214993 "" "Prometheus/2.33.4" 2024-09-17T01:00:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:12 smithi071 ceph-mon[23769]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:13.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:12 smithi071 ceph-mon[28615]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:13.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:12 smithi135 ceph-mon[24697]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:15.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:14 smithi071 ceph-mon[23769]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:15.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:14 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:15.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:14 smithi071 ceph-mon[28615]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:15.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:14 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:15.071 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:00:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:00:15.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:14 smithi135 ceph-mon[24697]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:15.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:14 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:16.028 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:15 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:16.028 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:16.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:15 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:16.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:15 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:16 smithi071 ceph-mon[23769]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:16 smithi071 ceph-mon[28615]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:17.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:16 smithi135 ceph-mon[24697]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:18 smithi071 ceph-mon[23769]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:19.164 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:18 smithi071 ceph-mon[28615]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:19.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:18 smithi135 ceph-mon[24697]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:20 smithi135 ceph-mon[24697]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:20.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:00:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:00:21.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:20 smithi071 ceph-mon[28615]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:21.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:20 smithi071 ceph-mon[23769]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:21.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:21] "GET /metrics HTTP/1.1" 200 214993 "" "Prometheus/2.33.4" 2024-09-17T01:00:23.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:22 smithi071 ceph-mon[23769]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:23.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:22 smithi071 ceph-mon[28615]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:23.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:22 smithi135 ceph-mon[24697]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:25.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:24 smithi071 ceph-mon[23769]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:25.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:24 smithi071 ceph-mon[28615]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:25.162 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:24 smithi135 ceph-mon[24697]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:26.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:25 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:26.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:25 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:26.181 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:25 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:27.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:26 smithi071 ceph-mon[28615]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:27.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:26 smithi071 ceph-mon[23769]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:27.195 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:26 smithi135 ceph-mon[24697]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:27.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:00:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:00:28.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:28 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:28.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:28 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:28.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:28 smithi135 ceph-mon[24697]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:28.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:28 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:28.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:28 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:28.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:28 smithi071 ceph-mon[23769]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:28.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:28 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:28 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:28 smithi071 ceph-mon[28615]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:30.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:30 smithi135 ceph-mon[24697]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:30.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:00:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:00:31.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:30 smithi071 ceph-mon[23769]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:31.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:30 smithi071 ceph-mon[28615]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:31.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:31] "GET /metrics HTTP/1.1" 200 214953 "" "Prometheus/2.33.4" 2024-09-17T01:00:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:32 smithi071 ceph-mon[23769]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:33.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:32 smithi071 ceph-mon[28615]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:32 smithi135 ceph-mon[24697]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:35.015 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:34 smithi071 ceph-mon[28615]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:35.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:34 smithi071 ceph-mon[23769]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:35.016 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:34 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:00:34] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:00:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:34 smithi135 ceph-mon[24697]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:36.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:35 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:36.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:35 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:36.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:35 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:36.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:35 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:36.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:35 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:36.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:35 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:36.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:35 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:35 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:35 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:36 smithi071 ceph-mon[23769]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:36 smithi071 ceph-mon[28615]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:36 smithi135 ceph-mon[24697]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:39.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:38 smithi071 ceph-mon[23769]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:38 smithi071 ceph-mon[28615]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:39.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:38 smithi135 ceph-mon[24697]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:40.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:00:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:00:40.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:40 smithi135 ceph-mon[24697]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:40.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:40 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:40.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:40 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:40.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:40 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:41.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:41] "GET /metrics HTTP/1.1" 200 214932 "" "Prometheus/2.33.4" 2024-09-17T01:00:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[23769]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[28615]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:40 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:43.131 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:42 smithi135 ceph-mon[24697]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:43.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:42 smithi071 ceph-mon[23769]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:43.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:42 smithi071 ceph-mon[28615]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:45.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:44 smithi071 ceph-mon[23769]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:45.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:44 smithi071 ceph-mon[28615]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:44 smithi135 ceph-mon[24697]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:46.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:45 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:46.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:45 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:46.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:45 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:47.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:46 smithi135 ceph-mon[24697]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:47.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:46 smithi071 ceph-mon[23769]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:47.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:46 smithi071 ceph-mon[28615]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:47.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:00:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:00:48.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:48 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:48.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:48 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:48.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:48 smithi071 ceph-mon[23769]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:48 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:48 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:48 smithi071 ceph-mon[28615]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:48.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:48 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:48.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:48 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:48.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:48 smithi135 ceph-mon[24697]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:50 smithi135 ceph-mon[24697]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:50.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:00:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:00:51.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:50 smithi071 ceph-mon[23769]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:51.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:50 smithi071 ceph-mon[28615]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:51.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:00:51] "GET /metrics HTTP/1.1" 200 214932 "" "Prometheus/2.33.4" 2024-09-17T01:00:53.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[28615]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[23769]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:00:53.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:00:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:52 smithi135 ceph-mon[24697]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:00:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:00:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:00:53.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:00:55.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:54 smithi071 ceph-mon[28615]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:55.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:54 smithi071 ceph-mon[23769]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:55.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:00:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:00:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:00:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:54 smithi135 ceph-mon[24697]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:00:55.938 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:55 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:55.938 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:55 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:55.938 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:55 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:55.939 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:55 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:55.939 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:55 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:55.939 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:55 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:56.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:55 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:00:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:55 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:55 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:00:57.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:56 smithi071 ceph-mon[23769]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:57.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:56 smithi071 ceph-mon[28615]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:56 smithi135 ceph-mon[24697]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:00:58 smithi071 ceph-mon[23769]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:59.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:00:58 smithi071 ceph-mon[28615]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:00:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:00:58 smithi135 ceph-mon[24697]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:00 smithi135 ceph-mon[24697]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:00.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:01:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:01:01.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:00 smithi071 ceph-mon[23769]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:01.125 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:00 smithi071 ceph-mon[28615]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:01.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:01] "GET /metrics HTTP/1.1" 200 214931 "" "Prometheus/2.33.4" 2024-09-17T01:01:03.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:02 smithi071 ceph-mon[23769]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:02 smithi071 ceph-mon[28615]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:02 smithi135 ceph-mon[24697]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:04 smithi071 ceph-mon[28615]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:05.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:04 smithi071 ceph-mon[23769]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:05.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:04 smithi135 ceph-mon[24697]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:06.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:05 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:05 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:06.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:05 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:07.072 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:06 smithi135 ceph-mon[24697]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:06 smithi071 ceph-mon[28615]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:07.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:06 smithi071 ceph-mon[23769]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:08.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:07 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:01:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:01:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:08 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:08 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:08.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:08 smithi135 ceph-mon[24697]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:09.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:08 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:09.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:08 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:09.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:08 smithi071 ceph-mon[28615]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:08 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:08 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:08 smithi071 ceph-mon[23769]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:10.855 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:01:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:01:11.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:10 smithi071 ceph-mon[28615]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:11.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:10 smithi071 ceph-mon[23769]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:11.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:10 smithi135 ceph-mon[24697]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:11.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:11] "GET /metrics HTTP/1.1" 200 214949 "" "Prometheus/2.33.4" 2024-09-17T01:01:13.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:12 smithi071 ceph-mon[28615]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:12 smithi071 ceph-mon[23769]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:13.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:12 smithi135 ceph-mon[24697]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:15.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:14 smithi071 ceph-mon[28615]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:15.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:14 smithi071 ceph-mon[23769]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:15.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:14 smithi135 ceph-mon[24697]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:15.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:01:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:01:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:15 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:15 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:15 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:16.895 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:16 smithi071 ceph-mon[23769]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:16.895 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:16 smithi071 ceph-mon[28615]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:17.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:16 smithi135 ceph-mon[24697]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:19.141 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:18 smithi071 ceph-mon[23769]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:19.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:18 smithi071 ceph-mon[28615]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:19.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:18 smithi135 ceph-mon[24697]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:20 smithi135 ceph-mon[24697]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:20.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:01:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:01:21.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:20 smithi071 ceph-mon[28615]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:21.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:20 smithi071 ceph-mon[23769]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:21.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:21] "GET /metrics HTTP/1.1" 200 214949 "" "Prometheus/2.33.4" 2024-09-17T01:01:21.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T01:01:23.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:22 smithi071 ceph-mon[28615]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:23.103 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:22 smithi071 ceph-mon[23769]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:23.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:22 smithi135 ceph-mon[24697]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:24.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T01:01:24.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:24 smithi071 ceph-mon[28615]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:24.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:24 smithi071 ceph-mon[23769]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:25.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:24 smithi135 ceph-mon[24697]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:26.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:25 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:26.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:25 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:26.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:25 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:27.085 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:26 smithi071 ceph-mon[23769]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:27.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:26 smithi071 ceph-mon[28615]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:27.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T01:01:27.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:26 smithi135 ceph-mon[24697]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:28.126 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:01:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:01:29.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:28 smithi071 ceph-mon[28615]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:29.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:28 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:29.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:28 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:29.085 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:28 smithi071 ceph-mon[23769]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:29.085 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:28 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:29.085 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:28 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:29.163 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:28 smithi135 ceph-mon[24697]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:29.163 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:28 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:29.163 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:28 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:29.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-17T01:01:30.817 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:01:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:01:31.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:30 smithi071 ceph-mon[23769]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:31.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:30 smithi071 ceph-mon[28615]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:31.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:30 smithi135 ceph-mon[24697]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:31.342 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:31] "GET /metrics HTTP/1.1" 200 214942 "" "Prometheus/2.33.4" 2024-09-17T01:01:31.756 INFO:teuthology.orchestra.run.smithi071.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:01:32.558 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:01:32.570 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-17T01:01:32.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-17T01:01:32.881 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:32.881 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:01:32.881 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:32.881 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:32.881 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:32.881 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[23769]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:01:32.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:32 smithi071 ceph-mon[28615]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:01:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:32 smithi135 ceph-mon[24697]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:34.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:34 smithi071 ceph-mon[23769]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:34.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:34 smithi071 ceph-mon[28615]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:34.897 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:01:35.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:34 smithi135 ceph-mon[24697]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 0s ago 8m - - 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 7s ago 8m - - 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (3m) 0s ago 3m 23.5M - ba2b418f427c 3a13fcf748bf 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (3m) 7s ago 3m 51.7M - 8.3.5 dad864ee21e9 8f7134c93bd0 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (2m) 0s ago 2m 52.5M - 3.5 e1d6a67b021e 856c169d39c9 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443 running (8m) 7s ago 8m 411M - 17.2.0 e1d6a67b021e 3e09849f10bc 2024-09-17T01:01:35.569 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:9283 running (9m) 0s ago 9m 463M - 17.2.0 e1d6a67b021e 4cb5022989e3 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (9m) 0s ago 9m 51.3M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (8m) 7s ago 8m 41.2M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (8m) 0s ago 8m 48.0M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (4m) 0s ago 4m 16.4M - 1dbe0e931976 41791b2fd73e 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (4m) 7s ago 4m 16.5M - 1dbe0e931976 ce77f45249e4 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (7m) 0s ago 7m 54.6M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (7m) 0s ago 7m 53.8M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (7m) 0s ago 7m 48.1M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (6m) 0s ago 6m 53.8M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (6m) 7s ago 6m 53.0M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (5m) 7s ago 5m 49.1M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (5m) 7s ago 5m 47.8M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:01:35.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (5m) 7s ago 5m 53.6M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:01:35.571 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (3m) 7s ago 4m 64.1M - 514e6a882f6e c1395755c361 2024-09-17T01:01:35.571 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (2m) 0s ago 2m 72.2M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:01:35.571 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (2m) 7s ago 2m 70.6M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:01:35.571 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (2m) 0s ago 2m 70.4M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:01:35.571 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (2m) 7s ago 2m 70.7M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:01:35.571 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:01:35] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:01:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[23769]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:35.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:35.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[28615]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:35.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:35.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:35 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:35.975 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:01:35.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:01:35.989 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:01:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:35 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:35 smithi135 ceph-mon[24697]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:35 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:35 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:36.327 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:01:36.328 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:01:36.328 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:01:36.328 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:01:36.328 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-17T01:01:36.328 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f image" 2024-09-17T01:01:36.328 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:01:36.744 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[28615]: from='client.24985 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[28615]: from='client.24991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[28615]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4214851581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4020772977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[23769]: from='client.24985 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[23769]: from='client.24991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[23769]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:37.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4214851581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:01:37.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:36 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4020772977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:01:37.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:36 smithi135 ceph-mon[24697]: from='client.24985 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:36 smithi135 ceph-mon[24697]: from='client.24991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:36 smithi135 ceph-mon[24697]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:36 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4214851581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:01:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:36 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4020772977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:01:37.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:37 smithi071 ceph-mon[28615]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:37.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:37 smithi071 ceph-mon[23769]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:38.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:37 smithi135 ceph-mon[24697]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:38 smithi071 ceph-mon[28615]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:39.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:38 smithi071 ceph-mon[23769]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:39.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:38 smithi135 ceph-mon[24697]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:40.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:40 smithi135 ceph-mon[24697]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:40.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:01:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:01:41.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:40 smithi071 ceph-mon[28615]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:41.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:40 smithi071 ceph-mon[23769]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:41.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:41] "GET /metrics HTTP/1.1" 200 214942 "" "Prometheus/2.33.4" 2024-09-17T01:01:43.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:42 smithi071 ceph-mon[23769]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:43.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:42 smithi071 ceph-mon[28615]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:42 smithi135 ceph-mon[24697]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:45.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:44 smithi071 ceph-mon[23769]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:45.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:44 smithi071 ceph-mon[28615]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:45.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:44 smithi135 ceph-mon[24697]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:46.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:45 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:46.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:45 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:46.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:45 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:47.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:46 smithi071 ceph-mon[28615]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:47.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:46 smithi071 ceph-mon[23769]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:47.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:46 smithi135 ceph-mon[24697]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:48.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:01:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:01:49.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:48 smithi135 ceph-mon[24697]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:49.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:48 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:49.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:48 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:49.296 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:48 smithi071 ceph-mon[28615]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:49.297 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:48 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:49.297 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:48 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:49.297 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:48 smithi071 ceph-mon[23769]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:49.297 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:48 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:49.297 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:48 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:50.817 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:01:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:01:51.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:50 smithi071 ceph-mon[28615]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:51.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:50 smithi071 ceph-mon[23769]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:51.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:50 smithi135 ceph-mon[24697]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:51.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:01:51] "GET /metrics HTTP/1.1" 200 214942 "" "Prometheus/2.33.4" 2024-09-17T01:01:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:52 smithi135 ceph-mon[24697]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:01:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:52 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:01:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:01:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:52 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:01:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[23769]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:01:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:01:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:01:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:01:53.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[28615]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:53.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:01:53.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:01:53.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:01:53.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:52 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:01:55.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:54 smithi071 ceph-mon[23769]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:55.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:54 smithi071 ceph-mon[28615]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:55.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:54 smithi135 ceph-mon[24697]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:01:55.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:01:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:01:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:01:56.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:55 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:56.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:55 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:56.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:55 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:56.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:55 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:56.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:55 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:56.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:55 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:55 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:01:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:55 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:55 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:01:57.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:56 smithi071 ceph-mon[23769]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:57.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:56 smithi071 ceph-mon[28615]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:56 smithi135 ceph-mon[24697]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:59.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:01:58 smithi071 ceph-mon[28615]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:01:58 smithi071 ceph-mon[23769]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:01:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:01:58 smithi135 ceph-mon[24697]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:00 smithi135 ceph-mon[24697]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:00.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:02:01.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:00 smithi071 ceph-mon[28615]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:01.048 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:00 smithi071 ceph-mon[23769]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:01.366 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:01] "GET /metrics HTTP/1.1" 200 214922 "" "Prometheus/2.33.4" 2024-09-17T01:02:03.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:02 smithi071 ceph-mon[28615]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:03.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:02 smithi071 ceph-mon[23769]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:03.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:02 smithi135 ceph-mon[24697]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:04.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:04 smithi135 ceph-mon[24697]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:04.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:04 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:04.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:04 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:04.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:04 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[23769]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[28615]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:04.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:04.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:04 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[23769]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:02:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[23769]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:02:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:02:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[23769]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f on smithi135 2024-09-17T01:02:06.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:06.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[28615]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:02:06.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[28615]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:02:06.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:02:06.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:05 smithi071 ceph-mon[28615]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f on smithi135 2024-09-17T01:02:06.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:05 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:05 smithi135 ceph-mon[24697]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:02:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:05 smithi135 ceph-mon[24697]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:02:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:05 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:02:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:05 smithi135 ceph-mon[24697]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f on smithi135 2024-09-17T01:02:07.081 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:06 smithi071 ceph-mon[23769]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:07.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:06 smithi071 ceph-mon[28615]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:07.082 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:02:07.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:06 smithi135 ceph-mon[24697]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:07.666 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 12s ago 9m - - 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 19s ago 9m - - 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (3m) 12s ago 4m 23.5M - ba2b418f427c 3a13fcf748bf 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (4m) 19s ago 4m 50.9M - 8.3.5 dad864ee21e9 8f7134c93bd0 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (2m) 12s ago 2m 52.6M - 3.5 e1d6a67b021e 856c169d39c9 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443 running (8m) 19s ago 8m 411M - 17.2.0 e1d6a67b021e 3e09849f10bc 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:9283 running (10m) 12s ago 10m 463M - 17.2.0 e1d6a67b021e 4cb5022989e3 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (10m) 12s ago 10m 49.9M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (8m) 19s ago 8m 37.5M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (9m) 12s ago 9m 40.9M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (4m) 12s ago 4m 16.7M - 1dbe0e931976 41791b2fd73e 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (4m) 19s ago 4m 15.6M - 1dbe0e931976 ce77f45249e4 2024-09-17T01:02:07.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (8m) 12s ago 8m 54.8M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (7m) 12s ago 7m 53.9M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (7m) 12s ago 7m 48.2M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (7m) 12s ago 7m 54.0M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (6m) 19s ago 6m 53.1M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (6m) 19s ago 6m 49.3M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (6m) 19s ago 6m 48.0M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (5m) 19s ago 5m 53.8M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (3m) 19s ago 5m 66.3M - 514e6a882f6e c1395755c361 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (3m) 12s ago 3m 72.2M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (3m) 19s ago 3m 70.7M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (2m) 12s ago 2m 70.6M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:02:07.668 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (2m) 19s ago 2m 70.9M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:02:08.023 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:02:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:02:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:02:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:02:08.023 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:02:08.024 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:02:08.325 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:02:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:02:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:02:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:02:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T01:02:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f image on host smithi135" 2024-09-17T01:02:08.326 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:02:08.326 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:02:08] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:02:08.680 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: from='client.25027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/104597742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:09.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3948228440' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: from='client.25027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/104597742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:09.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:08 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3948228440' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: from='client.25027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/104597742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:08 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3948228440' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:02:10.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:09 smithi071 ceph-mon[28615]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:10.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:09 smithi071 ceph-mon[23769]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:10.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:09 smithi135 ceph-mon[24697]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:10.880 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:02:11.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:10 smithi071 ceph-mon[23769]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:11.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:10 smithi071 ceph-mon[28615]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:11.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:11] "GET /metrics HTTP/1.1" 200 214875 "" "Prometheus/2.33.4" 2024-09-17T01:02:11.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:10 smithi135 ceph-mon[24697]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:12 smithi071 ceph-mon[23769]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:13.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:12 smithi071 ceph-mon[28615]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:13.202 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:12 smithi135 ceph-mon[24697]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:13.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:13.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:13.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:13.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs" 2024-09-17T01:02:14.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:14 smithi135 ceph-mon[24697]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:15.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:14 smithi071 ceph-mon[23769]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:15.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:14 smithi071 ceph-mon[28615]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:15.790 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:02:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:02:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:15 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:16.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:15 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:15 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:16.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:16.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:15 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:16.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:15 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:15 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:16 smithi071 ceph-mon[23769]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:16 smithi071 ceph-mon[28615]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:16 smithi135 ceph-mon[24697]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:18 smithi071 ceph-mon[23769]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:19.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:18 smithi071 ceph-mon[28615]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:19.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:18 smithi135 ceph-mon[24697]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:20.959 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:20 smithi135 ceph-mon[24697]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:20.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:02:21.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:20 smithi071 ceph-mon[23769]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:21.124 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:20 smithi071 ceph-mon[28615]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:21.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:21] "GET /metrics HTTP/1.1" 200 214875 "" "Prometheus/2.33.4" 2024-09-17T01:02:23.107 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:22 smithi071 ceph-mon[28615]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:23.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:22 smithi071 ceph-mon[23769]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:23.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:22 smithi135 ceph-mon[24697]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:23.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=error ts=2024-09-17T01:02:23.507Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:23.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:23.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:23.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:23.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs" 2024-09-17T01:02:25.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:24 smithi071 ceph-mon[28615]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:25.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:24 smithi071 ceph-mon[23769]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:25.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:24 smithi135 ceph-mon[24697]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:25.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:25 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:26.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:25 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:26.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:25 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:27.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:26 smithi071 ceph-mon[23769]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:27.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:26 smithi071 ceph-mon[28615]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:27.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:26 smithi135 ceph-mon[24697]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:28.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.135 - - [17/Sep/2024:01:02:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:02:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:28 smithi071 ceph-mon[28615]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:28 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:28 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:28 smithi071 ceph-mon[23769]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:29.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:28 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:29.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:28 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:28 smithi135 ceph-mon[24697]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:28 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:28 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:30 smithi135 ceph-mon[24697]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:30.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[26255]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:02:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:30 smithi071 ceph-mon[23769]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:31.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:31] "GET /metrics HTTP/1.1" 200 214884 "" "Prometheus/2.33.4" 2024-09-17T01:02:31.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:30 smithi071 ceph-mon[28615]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:33.107 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:32 smithi135 ceph-mon[24697]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:32 smithi071 ceph-mon[23769]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:33.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:32 smithi071 ceph-mon[28615]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:33.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:33 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=error ts=2024-09-17T01:02:33.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:33.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:33 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:33.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:33 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs" 2024-09-17T01:02:34.921 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:34 smithi135 ceph-mon[24697]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:34 smithi071 ceph-mon[23769]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:35.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:34 smithi071 ceph-mon[28615]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:35.798 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 172.21.15.71 - - [17/Sep/2024:01:02:35] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-09-17T01:02:36.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:35 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:36.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:35 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:36.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:35 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:36.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:35 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:36.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:35 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:36.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:35 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:36.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:35 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:36.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:35 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:36.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:35 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:37.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:36 smithi135 ceph-mon[24697]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:37.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:36 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:37.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:36 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:02:37.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:36 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:02:37.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:36 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:02:37.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:36 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[23769]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:02:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:02:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:02:37.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[28615]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:02:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:02:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:02:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:36 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:38.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:37 smithi135 ceph-mon[24697]: Upgrade: Updating mgr.x 2024-09-17T01:02:38.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:37 smithi135 ceph-mon[24697]: Deploying daemon mgr.x on smithi135 2024-09-17T01:02:38.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:37 smithi071 ceph-mon[28615]: Upgrade: Updating mgr.x 2024-09-17T01:02:38.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:37 smithi071 ceph-mon[28615]: Deploying daemon mgr.x on smithi135 2024-09-17T01:02:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:37 smithi071 ceph-mon[23769]: Upgrade: Updating mgr.x 2024-09-17T01:02:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:37 smithi071 ceph-mon[23769]: Deploying daemon mgr.x on smithi135 2024-09-17T01:02:38.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:38 smithi135 systemd[1]: Stopping Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:02:38.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:38 smithi135 bash[50285]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr.x" found: no such container 2024-09-17T01:02:38.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:38 smithi135 podman[50295]: 2024-09-17 01:02:38.222922839 +0000 UTC m=+0.129113608 container died 3e09849f10bc62ae017bf011ec890a4cdded5c6ab2270f194aad7b4230d933de (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , release=754, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., io.buildah.version=1.19.8, version=8, build-date=2022-05-03T08:36:31.336870) 2024-09-17T01:02:39.010 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:02:39.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:38 smithi071 ceph-mon[23769]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:38 smithi071 ceph-mon[28615]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:39.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:38 smithi135 ceph-mon[24697]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:39.621 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 4s ago 9m - - 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 11s ago 9m - - 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (4m) 4s ago 5m 25.7M - ba2b418f427c 3a13fcf748bf 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (4m) 11s ago 4m 51.2M - 8.3.5 dad864ee21e9 8f7134c93bd0 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (3m) 4s ago 3m 54.8M - 3.5 e1d6a67b021e 856c169d39c9 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443 running (9m) 11s ago 9m 412M - 17.2.0 e1d6a67b021e 3e09849f10bc 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:9283 running (10m) 4s ago 10m 466M - 17.2.0 e1d6a67b021e 4cb5022989e3 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (10m) 4s ago 10m 50.2M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (9m) 11s ago 9m 37.6M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (9m) 4s ago 9m 42.3M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (5m) 4s ago 5m 16.0M - 1dbe0e931976 41791b2fd73e 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (5m) 11s ago 5m 16.2M - 1dbe0e931976 ce77f45249e4 2024-09-17T01:02:39.622 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (8m) 4s ago 8m 55.1M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (8m) 4s ago 8m 54.1M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (8m) 4s ago 8m 48.5M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (7m) 4s ago 7m 54.5M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (7m) 11s ago 7m 53.5M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (6m) 11s ago 6m 49.6M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (6m) 11s ago 6m 48.2M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (6m) 11s ago 6m 54.1M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (4m) 11s ago 5m 66.3M - 514e6a882f6e c1395755c361 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (3m) 4s ago 3m 72.4M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (3m) 11s ago 3m 71.0M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (3m) 4s ago 3m 70.9M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:02:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (3m) 11s ago 3m 71.1M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:02:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 17 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:02:39.979 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:02:40.288 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:02:40.288 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:02:40.288 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:02:40.288 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:02:40.288 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T01:02:40.288 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons" 2024-09-17T01:02:40.289 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:02:40.652 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:02:41.122 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:40.857Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=6 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": dial tcp 172.21.15.135:8443: connect: connection refused" 2024-09-17T01:02:41.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[28615]: from='client.25051 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[28615]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[28615]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[28615]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:41.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2229671781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:41.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2479589621' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:02:41.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[23769]: from='client.25051 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[23769]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[23769]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[23769]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:41.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2229671781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:41.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:40 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2479589621' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:02:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:40 smithi135 ceph-mon[24697]: from='client.25051 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:40 smithi135 ceph-mon[24697]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:40 smithi135 ceph-mon[24697]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:40 smithi135 ceph-mon[24697]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:02:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:40 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2229671781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:40 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2479589621' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:02:41.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:40 smithi135 podman[50295]: 2024-09-17 01:02:40.920255434 +0000 UTC m=+2.826446205 container cleanup 3e09849f10bc62ae017bf011ec890a4cdded5c6ab2270f194aad7b4230d933de (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, name=centos-stream, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, RELEASE=HEAD, version=8, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, vendor=Red Hat, Inc., io.buildah.version=1.19.8) 2024-09-17T01:02:41.211 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:40 smithi135 bash[50295]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x 2024-09-17T01:02:41.211 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:40 smithi135 bash[50321]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr.x" found: no such container 2024-09-17T01:02:41.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:41] "GET /metrics HTTP/1.1" 200 214878 "" "Prometheus/2.33.4" 2024-09-17T01:02:42.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:41 smithi071 ceph-mon[23769]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:42.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:41 smithi071 ceph-mon[28615]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:41 smithi135 ceph-mon[24697]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:42.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 podman[50307]: 2024-09-17 01:02:42.355685271 +0000 UTC m=+4.128005792 container remove 3e09849f10bc62ae017bf011ec890a4cdded5c6ab2270f194aad7b4230d933de (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, GIT_CLEAN=True, distribution-scope=public, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, vcs-type=git, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., name=centos-stream) 2024-09-17T01:02:42.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:02:42.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-09-17T01:02:42.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 systemd[1]: Stopped Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:02:42.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service: Consumed 17.134s CPU time. 2024-09-17T01:02:42.711 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 systemd[1]: Starting Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:02:43.106 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:42 smithi135 ceph-mon[24697]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:43.107 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 podman[50422]: 2024-09-17 01:02:42.690470963 +0000 UTC m=+0.016342540 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:02:43.107 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:42 smithi135 podman[50422]: 2024-09-17 01:02:42.840669688 +0000 UTC m=+0.166541302 container create 0231b65a214507ccb47c42a05310a88becd0f129d255ebcdd851408cece29032 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:02:43.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:42 smithi071 ceph-mon[23769]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:43.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:42 smithi071 ceph-mon[28615]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:02:43.458 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 podman[50422]: 2024-09-17 01:02:43.109788169 +0000 UTC m=+0.435659740 container init 0231b65a214507ccb47c42a05310a88becd0f129d255ebcdd851408cece29032 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:02:43.458 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 podman[50422]: 2024-09-17 01:02:43.112912958 +0000 UTC m=+0.438784532 container start 0231b65a214507ccb47c42a05310a88becd0f129d255ebcdd851408cece29032 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:02:43.458 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 ceph-mgr[50442]: -- 172.21.15.135:0/3532188342 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640aa6eb0e0 con 0x5640aa6c9000 2024-09-17T01:02:43.458 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 bash[50422]: 0231b65a214507ccb47c42a05310a88becd0f129d255ebcdd851408cece29032 2024-09-17T01:02:43.459 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 systemd[1]: Started Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:02:43.459 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:43.238+0000 7fae6b561040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:02:43.459 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:43.315+0000 7fae6b561040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:02:43.646 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=error ts=2024-09-17T01:02:43.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.135:8443/api/prometheus_receiver\": dial tcp 172.21.15.135:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:43.646 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:43.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": dial tcp 172.21.15.135:8443: connect: connection refused" 2024-09-17T01:02:43.646 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:43.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:43.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:43.486+0000 7fae6b561040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:02:43.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:43.562+0000 7fae6b561040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:02:44.085 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:43.752+0000 7fae6b561040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:02:44.085 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:43.911+0000 7fae6b561040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:02:44.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:44.238+0000 7fae6b561040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:02:44.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:44.303+0000 7fae6b561040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: Failing over to other MGR 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: osdmap e95: 8 total, 8 up, 8 in 2024-09-17T01:02:44.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:02:44.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:02:44.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:44.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:44.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:02:44.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:44.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:02:44.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: Failing over to other MGR 2024-09-17T01:02:44.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: osdmap e95: 8 total, 8 up, 8 in 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: Failing over to other MGR 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 172.21.15.71:0/1994926085' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: osdmap e95: 8 total, 8 up, 8 in 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:02:44.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:02:44.852 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:44.506+0000 7fae6b561040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:02:44.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:44.679Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=3 err="Post \"https://172.21.15.71:8443//api/prometheus_receiver\": dial tcp 172.21.15.71:8443: connect: connection refused" 2024-09-17T01:02:44.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setuser ceph since I am not root 2024-09-17T01:02:44.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ignoring --setgroup ceph since I am not root 2024-09-17T01:02:44.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-mgr[24000]: -- 172.21.15.71:0/966403397 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c986f42340 con 0x55c986f1b000 2024-09-17T01:02:44.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:44.736+0000 7f7560319000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:02:44.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:44.815+0000 7f7560319000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:02:45.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:44 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:44.988+0000 7f7560319000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:02:45.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:45.077+0000 7f7560319000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:02:45.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:45.207+0000 7f7560319000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:02:45.739 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-mon[23769]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-17T01:02:45.739 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-mon[23769]: mgrmap e21: x(active, starting, since 1.00149s), standbys: y 2024-09-17T01:02:45.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-mon[28615]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-17T01:02:45.740 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-mon[28615]: mgrmap e21: x(active, starting, since 1.00149s), standbys: y 2024-09-17T01:02:45.740 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:45.415+0000 7f7560319000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:02:45.769 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:45 smithi135 ceph-mon[24697]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-17T01:02:45.769 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:45 smithi135 ceph-mon[24697]: mgrmap e21: x(active, starting, since 1.00149s), standbys: y 2024-09-17T01:02:45.769 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:45.468+0000 7fae6b561040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:02:45.769 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:45.536+0000 7fae6b561040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:02:45.998 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:45.741+0000 7f7560319000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:02:45.998 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:45 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:45.833+0000 7f7560319000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:02:45.998 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:46.000+0000 7f7560319000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:02:46.561 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:46.292+0000 7fae6b561040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:02:46.561 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:46.414+0000 7fae6b561040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:02:46.855 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:46.563+0000 7fae6b561040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:02:46.856 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:46.625+0000 7fae6b561040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:02:46.856 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:46.789+0000 7fae6b561040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:02:46.856 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:46.857+0000 7fae6b561040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:02:47.165 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:46.919+0000 7fae6b561040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:02:47.165 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:47.101+0000 7fae6b561040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:02:47.165 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:47.167+0000 7fae6b561040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:02:47.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:47.055+0000 7f7560319000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:02:47.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:47.146+0000 7f7560319000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:02:47.444 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:47.236+0000 7fae6b561040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:02:47.444 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:47.320+0000 7fae6b561040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:02:47.444 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:47.380+0000 7fae6b561040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:02:47.444 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:47.446+0000 7fae6b561040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:02:48.304 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:48.041+0000 7f7560319000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:02:48.512 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-mon[24697]: Active manager daemon x restarted 2024-09-17T01:02:48.512 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-mon[24697]: Activating manager daemon x 2024-09-17T01:02:48.512 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-mon[24697]: osdmap e96: 8 total, 8 up, 8 in 2024-09-17T01:02:48.512 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:48.239+0000 7fae6b561040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Bus STARTING 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: CherryPy Checker: 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: The Application mounted at '' has an empty config. 2024-09-17T01:02:48.513 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:48.514 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Serving on http://:::9283 2024-09-17T01:02:48.514 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Bus STARTED 2024-09-17T01:02:48.514 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Bus STOPPING 2024-09-17T01:02:48.514 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:02:48.514 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Bus STOPPED 2024-09-17T01:02:48.514 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Bus STARTING 2024-09-17T01:02:48.588 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[23769]: Active manager daemon x restarted 2024-09-17T01:02:48.588 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[23769]: Activating manager daemon x 2024-09-17T01:02:48.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[23769]: osdmap e96: 8 total, 8 up, 8 in 2024-09-17T01:02:48.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:02:48.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:48.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:02:48.589 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:48.590 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:48.355+0000 7f7560319000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:02:48.590 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:48.494+0000 7f7560319000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:02:48.590 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:48.590+0000 7f7560319000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:02:48.590 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[28615]: Active manager daemon x restarted 2024-09-17T01:02:48.590 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[28615]: Activating manager daemon x 2024-09-17T01:02:48.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[28615]: osdmap e96: 8 total, 8 up, 8 in 2024-09-17T01:02:48.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:02:48.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:48.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:02:48.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:48.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Serving on http://:::9283 2024-09-17T01:02:48.865 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:02:48] ENGINE Bus STARTED 2024-09-17T01:02:48.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:48.691+0000 7f7560319000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:02:48.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:48.784+0000 7f7560319000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:02:49.319 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:48.938+0000 7f7560319000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:02:49.319 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:49.038+0000 7f7560319000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:02:49.319 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:49.144+0000 7f7560319000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:02:49.640 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:49.505Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=6 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs" 2024-09-17T01:02:49.640 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:49.450+0000 7f7560319000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:02:49.640 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:49.546+0000 7f7560319000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:02:49.640 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:49.642+0000 7f7560319000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:02:49.640 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: mgrmap e22: x(active, starting, since 0.0602144s), standbys: y 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:49.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Manager daemon x is now available 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Queued rgw.foo for migration 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Queued rgw.smpl for migration 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Migrating certs/keys for iscsi.foo spec to cert store 2024-09-17T01:02:49.642 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Migrating certs/keys for rgw.foo spec to cert store 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Migrating certs/keys for rgw.smpl spec to cert store 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Checking for cert/key for grafana.a 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: mgrmap e22: x(active, starting, since 0.0602144s), standbys: y 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:02:49.643 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:02:49.644 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Manager daemon x is now available 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Queued rgw.foo for migration 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Queued rgw.smpl for migration 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Migrating certs/keys for iscsi.foo spec to cert store 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Migrating certs/keys for rgw.foo spec to cert store 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Migrating certs/keys for rgw.smpl spec to cert store 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Checking for cert/key for grafana.a 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.645 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:49.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[23769]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:49.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:49.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:49.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:49.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:49.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:49 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: mgrmap e22: x(active, starting, since 0.0602144s), standbys: y 2024-09-17T01:02:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:02:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:02:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:02:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:02:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Manager daemon x is now available 2024-09-17T01:02:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Queued rgw.foo for migration 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Queued rgw.smpl for migration 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'smpl', 'service_name': 'rgw.smpl', 'service_type': 'rgw'} 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Migrating certs/keys for iscsi.foo spec to cert store 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Migrating certs/keys for rgw.foo spec to cert store 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Migrating certs/keys for rgw.smpl spec to cert store 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Checking for cert/key for grafana.a 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:49 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: mgrmap e23: x(active, since 1.07542s), standbys: y 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: mgrmap e23: x(active, since 1.07542s), standbys: y 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:02:50.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:02:50.705 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:50.705 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:50.705 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: mgrmap e23: x(active, since 1.07542s), standbys: y 2024-09-17T01:02:50.705 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:50.705 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.707 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:50.707 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:02:50.707 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:02:50.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:50] "GET /metrics HTTP/1.1" 200 35353 "" "Prometheus/2.33.4" 2024-09-17T01:02:51.091 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:50.745+0000 7f7560319000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:02:51.091 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:01:02:50] ENGINE Bus STARTING 2024-09-17T01:02:51.091 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: CherryPy Checker: 2024-09-17T01:02:51.091 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: The Application mounted at '' has an empty config. 2024-09-17T01:02:51.091 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: 2024-09-17T01:02:51.091 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:01:02:50] ENGINE Serving on http://:::9283 2024-09-17T01:02:51.091 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: [17/Sep/2024:01:02:50] ENGINE Bus STARTED 2024-09-17T01:02:51.327 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:50.974+0000 7fadbe508640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:01:02:50] ENGINE Error in HTTPServer.serve 2024-09-17T01:02:51.327 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Traceback (most recent call last): 2024-09-17T01:02:51.327 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:02:51.327 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: self._connections.run(self.expiration_interval) 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: self._run(expiration_interval) 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: s = self.context.wrap_socket( 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: return self.sslsocket_class._create( 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: self.do_handshake() 2024-09-17T01:02:51.328 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:02:51.329 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: self._sslobj.do_handshake() 2024-09-17T01:02:51.329 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:02:51.329 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:02:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:02:51.395 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:02:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: Standby manager daemon y restarted 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:51.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: [17/Sep/2024:01:02:50] ENGINE Bus STARTING 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: [17/Sep/2024:01:02:50] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: mgrmap e24: x(active, since 2s), standbys: y 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: [17/Sep/2024:01:02:50] ENGINE Serving on https://172.21.15.135:7150 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: [17/Sep/2024:01:02:50] ENGINE Bus STARTED 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: [17/Sep/2024:01:02:50] ENGINE Error in HTTPServer.serve 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:02:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: self.do_handshake() 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[23769]: Reconfiguring daemon agent.smithi071 on smithi071 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:51.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: Standby manager daemon y restarted 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: [17/Sep/2024:01:02:50] ENGINE Bus STARTING 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: [17/Sep/2024:01:02:50] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: mgrmap e24: x(active, since 2s), standbys: y 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: [17/Sep/2024:01:02:50] ENGINE Serving on https://172.21.15.135:7150 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: [17/Sep/2024:01:02:50] ENGINE Bus STARTED 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: [17/Sep/2024:01:02:50] ENGINE Error in HTTPServer.serve 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:02:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.do_handshake() 2024-09-17T01:02:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:02:51.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:02:51.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:02:51.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:51 smithi071 ceph-mon[28615]: Reconfiguring daemon agent.smithi071 on smithi071 2024-09-17T01:02:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: Standby manager daemon y restarted 2024-09-17T01:02:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:02:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:02:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:02:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1298167578' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: [17/Sep/2024:01:02:50] ENGINE Bus STARTING 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: [17/Sep/2024:01:02:50] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: mgrmap e24: x(active, since 2s), standbys: y 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: [17/Sep/2024:01:02:50] ENGINE Serving on https://172.21.15.135:7150 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: [17/Sep/2024:01:02:50] ENGINE Bus STARTED 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: [17/Sep/2024:01:02:50] ENGINE Error in HTTPServer.serve 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._run(expiration_interval) 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:02:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: s = self.context.wrap_socket( 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.sslsocket_class._create( 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: self.do_handshake() 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._sslobj.do_handshake() 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:02:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:51 smithi135 ceph-mon[24697]: Reconfiguring daemon agent.smithi071 on smithi071 2024-09-17T01:02:52.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[23769]: Deploying cephadm binary to smithi071 2024-09-17T01:02:52.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.451 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[28615]: Deploying cephadm binary to smithi071 2024-09-17T01:02:52.452 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.452 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.452 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:52 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:52 smithi135 ceph-mon[24697]: Deploying cephadm binary to smithi071 2024-09-17T01:02:52.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:52 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:52 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:52.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:52 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:53.333 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:53 smithi071 systemd[1]: Stopping Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:02:53.544 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:53 smithi135 ceph-mon[24697]: Reconfiguring node-exporter.a (dependencies changed)... 2024-09-17T01:02:53.544 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:53 smithi135 ceph-mon[24697]: Deploying daemon node-exporter.a on smithi071 2024-09-17T01:02:53.544 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:53 smithi135 ceph-mon[24697]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:53.544 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:53 smithi135 ceph-mon[24697]: mgrmap e25: x(active, since 4s), standbys: y 2024-09-17T01:02:53.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[23769]: Reconfiguring node-exporter.a (dependencies changed)... 2024-09-17T01:02:53.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[23769]: Deploying daemon node-exporter.a on smithi071 2024-09-17T01:02:53.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[23769]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:53.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[23769]: mgrmap e25: x(active, since 4s), standbys: y 2024-09-17T01:02:53.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[28615]: Reconfiguring node-exporter.a (dependencies changed)... 2024-09-17T01:02:53.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[28615]: Deploying daemon node-exporter.a on smithi071 2024-09-17T01:02:53.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[28615]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:53.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-mon[28615]: mgrmap e25: x(active, since 4s), standbys: y 2024-09-17T01:02:53.647 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=error ts=2024-09-17T01:02:53.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.71:8443//api/prometheus_receiver\": dial tcp 172.21.15.71:8443: connect: connection refused" 2024-09-17T01:02:53.647 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:53.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs" 2024-09-17T01:02:53.647 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:02:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:02:53.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:02:55.396 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 podman[61876]: 2024-09-17 01:02:55.106012105 +0000 UTC m=+0.636549028 container cleanup 41791b2fd73e0d6031685f40116c6b171fe525360edb8336147396383e56ff50 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:02:55.396 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 bash[61876]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a 2024-09-17T01:02:55.704 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 podman[61888]: 2024-09-17 01:02:55.441615815 +0000 UTC m=+0.837425247 container remove 41791b2fd73e0d6031685f40116c6b171fe525360edb8336147396383e56ff50 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:02:55.704 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:02:55.704 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-17T01:02:55.704 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 systemd[1]: Stopped Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:02:55.704 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.a.service: Consumed 3.159s CPU time. 2024-09-17T01:02:56.017 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:55 smithi071 systemd[1]: Starting Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:02:56.017 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:55 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:56.017 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:55 smithi071 ceph-mon[28615]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:56.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:55 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:56.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:55 smithi071 ceph-mon[23769]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:55 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:02:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:55 smithi135 ceph-mon[24697]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:02:56.396 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:56 smithi071 bash[62098]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-17T01:02:57.475 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:57 smithi071 bash[62098]: Getting image source signatures 2024-09-17T01:02:57.475 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:57 smithi071 bash[62098]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-17T01:02:57.475 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:57 smithi071 bash[62098]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-17T01:02:57.476 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:57 smithi071 bash[62098]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-17T01:02:58.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:57 smithi071 ceph-mon[23769]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:02:58.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:57 smithi071 ceph-mon[28615]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:02:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:57 smithi135 ceph-mon[24697]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:02:59.146 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:58 smithi071 bash[62098]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-17T01:02:59.146 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:58 smithi071 bash[62098]: Writing manifest to image destination 2024-09-17T01:02:59.573 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 podman[62098]: 2024-09-17 01:02:59.199682382 +0000 UTC m=+3.285286094 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-17T01:02:59.573 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 podman[62098]: 2024-09-17 01:02:59.27340943 +0000 UTC m=+3.359013184 container create ac488328042747748583b43cc3e6195a96f1d4f669bf8778dd87f65273c2a19d (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:02:59.573 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 podman[62098]: 2024-09-17 01:02:59.475501328 +0000 UTC m=+3.561105039 container init ac488328042747748583b43cc3e6195a96f1d4f669bf8778dd87f65273c2a19d (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:02:59.573 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 podman[62098]: 2024-09-17 01:02:59.478501836 +0000 UTC m=+3.564105550 container start ac488328042747748583b43cc3e6195a96f1d4f669bf8778dd87f65273c2a19d (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:02:59.573 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.482Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.482Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.482Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.482Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=arp 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-17T01:02:59.574 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=edac 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-17T01:02:59.575 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-17T01:02:59.576 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=os 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=stat 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=time 2024-09-17T01:02:59.577 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-17T01:02:59.578 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=uname 2024-09-17T01:02:59.578 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-17T01:02:59.578 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-17T01:02:59.578 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.483Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-17T01:02:59.578 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.484Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-17T01:02:59.578 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a[62407]: ts=2024-09-17T01:02:59.484Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-17T01:02:59.578 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 bash[62098]: ac488328042747748583b43cc3e6195a96f1d4f669bf8778dd87f65273c2a19d 2024-09-17T01:02:59.896 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:02:59 smithi071 systemd[1]: Started Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:02:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-mon[23769]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:02:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:59.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-mon[28615]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:02:59.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:02:59.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:02:59 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:59 smithi135 ceph-mon[24697]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:03:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:59 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:02:59 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:00 smithi135 ceph-mon[24697]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T01:03:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:00 smithi135 ceph-mon[24697]: Deploying daemon alertmanager.a on smithi071 2024-09-17T01:03:00.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:00] "GET /metrics HTTP/1.1" 200 35353 "" "Prometheus/2.33.4" 2024-09-17T01:03:01.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:00 smithi071 ceph-mon[28615]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T01:03:01.124 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:00 smithi071 ceph-mon[28615]: Deploying daemon alertmanager.a on smithi071 2024-09-17T01:03:01.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:00 smithi071 ceph-mon[23769]: Reconfiguring alertmanager.a (dependencies changed)... 2024-09-17T01:03:01.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:00 smithi071 ceph-mon[23769]: Deploying daemon alertmanager.a on smithi071 2024-09-17T01:03:01.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:03:02.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:01 smithi071 ceph-mon[23769]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:03:02.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:01 smithi071 ceph-mon[28615]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:03:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:01 smithi135 ceph-mon[24697]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:03:02.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:02.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.71:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.135:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:03:03.818 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=error ts=2024-09-17T01:03:03.510Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:03:03.818 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:03:03.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.71:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.71 because it doesn't contain any IP SANs" 2024-09-17T01:03:03.818 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:03 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=warn ts=2024-09-17T01:03:03.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.135:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.135 because it doesn't contain any IP SANs" 2024-09-17T01:03:04.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:03 smithi071 ceph-mon[23769]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:04.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:03 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:03 smithi071 ceph-mon[28615]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:03 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:03 smithi135 ceph-mon[24697]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:03 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:06.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:05 smithi071 ceph-mon[28615]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:06.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:05 smithi071 ceph-mon[28615]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:05 smithi071 ceph-mon[23769]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:05 smithi071 ceph-mon[23769]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:05 smithi135 ceph-mon[24697]: from='client.14937 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:05 smithi135 ceph-mon[24697]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:08.009 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:07 smithi071 ceph-mon[23769]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:08.010 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:07 smithi071 ceph-mon[28615]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:07 smithi135 ceph-mon[24697]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:03:08.631 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:08 smithi071 systemd[1]: Stopping Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:08.891 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:08 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[48699]: level=info ts=2024-09-17T01:03:08.633Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-09-17T01:03:08.891 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:08 smithi071 podman[62846]: 2024-09-17 01:03:08.654148489 +0000 UTC m=+0.127157948 container died 3a13fcf748bf15cf7cedaec4a48543435a7753a23750f8e7544c93f8c8646e71 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:09.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 podman[62846]: 2024-09-17 01:03:09.075654425 +0000 UTC m=+0.548663882 container cleanup 3a13fcf748bf15cf7cedaec4a48543435a7753a23750f8e7544c93f8c8646e71 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:09.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 bash[62846]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a 2024-09-17T01:03:09.646 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 podman[62858]: 2024-09-17 01:03:09.301968993 +0000 UTC m=+0.647145911 container remove 3a13fcf748bf15cf7cedaec4a48543435a7753a23750f8e7544c93f8c8646e71 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:09.646 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 podman[62858]: 2024-09-17 01:03:09.52951314 +0000 UTC m=+0.874690056 volume remove cc208d0544c475bb6baead9a334975e8ce748c9f3dfe3abc6d81272d22a8c805 2024-09-17T01:03:10.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:09 smithi071 ceph-mon[23769]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:10.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:09 smithi071 ceph-mon[28615]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:10.145 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-17T01:03:10.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 systemd[1]: Stopped Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:10.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@alertmanager.a.service: Consumed 1.138s CPU time. 2024-09-17T01:03:10.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:09 smithi071 systemd[1]: Starting Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:10.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:09 smithi135 ceph-mon[24697]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:10.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 podman[62983]: 2024-09-17 01:03:10.147857765 +0000 UTC m=+0.087914616 volume create 7ae179ff1a671d78381ad2a86df19c38db90a916de72302f11d5406e69d46028 2024-09-17T01:03:10.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 podman[62983]: 2024-09-17 01:03:10.075803978 +0000 UTC m=+0.015860773 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-09-17T01:03:10.396 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 podman[62983]: 2024-09-17 01:03:10.256746702 +0000 UTC m=+0.196803536 container create f51d370b6cd50fce9bcde453f9c3fce7e88c42fceddc01d1560983fe42c00a83 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:10.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 podman[62983]: 2024-09-17 01:03:10.559138246 +0000 UTC m=+0.499195044 container init f51d370b6cd50fce9bcde453f9c3fce7e88c42fceddc01d1560983fe42c00a83 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:10.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 podman[62983]: 2024-09-17 01:03:10.562069164 +0000 UTC m=+0.502125950 container start f51d370b6cd50fce9bcde453f9c3fce7e88c42fceddc01d1560983fe42c00a83 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:10.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.573Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.574Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.575Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.71 port=9094 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.576Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.599Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.599Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.602Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:10.602Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 bash[62983]: f51d370b6cd50fce9bcde453f9c3fce7e88c42fceddc01d1560983fe42c00a83 2024-09-17T01:03:10.897 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:10 smithi071 systemd[1]: Started Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:10.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:10] "GET /metrics HTTP/1.1" 200 38156 "" "Prometheus/2.33.4" 2024-09-17T01:03:11.029 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:03:11.246 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:03:11.718 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:03:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 starting - - - - 2024-09-17T01:03:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 43s ago 10m - - 2024-09-17T01:03:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 starting - - - - 2024-09-17T01:03:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (5m) 43s ago 5m 51.2M - 8.3.5 dad864ee21e9 8f7134c93bd0 2024-09-17T01:03:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (3m) 36s ago 3m 54.8M - 3.5 e1d6a67b021e 856c169d39c9 2024-09-17T01:03:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283 starting - - - - 2024-09-17T01:03:11.719 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:9283 running (11m) 36s ago 11m 466M - 17.2.0 e1d6a67b021e 4cb5022989e3 2024-09-17T01:03:11.720 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (11m) 36s ago 11m 50.2M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:03:11.720 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (10m) 43s ago 9m 37.6M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:03:11.720 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (10m) 36s ago 10m 42.3M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:03:11.720 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 starting - - - - 2024-09-17T01:03:11.720 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (5m) 43s ago 5m 16.2M - 1dbe0e931976 ce77f45249e4 2024-09-17T01:03:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (9m) 36s ago 9m 55.1M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:03:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (9m) 36s ago 9m 54.1M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:03:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (8m) 36s ago 8m 48.5M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:03:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (8m) 36s ago 8m 54.5M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:03:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (7m) 43s ago 7m 53.5M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:03:11.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (7m) 43s ago 7m 49.6M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:03:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (7m) 43s ago 7m 48.2M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:03:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (6m) 43s ago 6m 54.1M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:03:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (4m) 43s ago 6m 66.3M - 514e6a882f6e c1395755c361 2024-09-17T01:03:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (4m) 36s ago 4m 72.4M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:03:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (4m) 43s ago 4m 71.0M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:03:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (3m) 36s ago 3m 70.9M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:03:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (3m) 43s ago 3m 71.1M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:03:12.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[28615]: from='client.25123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:03:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:11 smithi071 ceph-mon[23769]: from='client.25123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.133 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:03:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:03:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:03:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:03:12.134 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:03:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:11 smithi135 ceph-mon[24697]: from='client.25123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.497 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:03:12.497 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:03:12.497 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:03:12.497 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:03:12.497 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:03:12.498 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-17T01:03:12.498 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "", 2024-09-17T01:03:12.498 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:03:12.498 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:03:12.605 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:12.315Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.71:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.135:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:03:12.747 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:12.576Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000019715s 2024-09-17T01:03:12.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:12 smithi071 ceph-mon[23769]: from='client.25129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:12 smithi071 ceph-mon[23769]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.747 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:12 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/755930650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:12.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:12 smithi071 ceph-mon[28615]: from='client.25129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:12 smithi071 ceph-mon[28615]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.748 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:12 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/755930650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:12.910 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:03:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:12 smithi135 ceph-mon[24697]: from='client.25129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:12 smithi135 ceph-mon[24697]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:12 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/755930650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:13 smithi071 ceph-mon[23769]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:13 smithi071 ceph-mon[23769]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:13 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3991884976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:03:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:13 smithi071 ceph-mon[28615]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:13 smithi071 ceph-mon[28615]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:13 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3991884976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:03:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:13 smithi135 ceph-mon[24697]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:13 smithi135 ceph-mon[24697]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:13 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3991884976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:03:14.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:14 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:14.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:14 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:14.890 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:14 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:14.890 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:14 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:14.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:03:14.739+0000 7fadfb83f640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:14.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Creating ceph-iscsi config... 2024-09-17T01:03:14.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:14.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:14.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Traceback (most recent call last): 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: return _run_code(code, main_globals, None, 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: exec(code, run_globals) 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:14.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Traceback (most recent call last): 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:03:14.962 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: return self.wait_async( 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: return future.result(timeout) 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: return self.__get_result() 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: raise self._exception 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: out, err, code = await self._run_cephadm( 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: raise OrchestratorError( 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:14.963 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Creating ceph-iscsi config... 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: Traceback (most recent call last): 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: return _run_code(code, main_globals, None, 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: exec(code, run_globals) 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:14.964 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:14.965 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:14.965 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:14.965 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:14.965 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:14.965 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.063 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:15 smithi071 ceph-mon[23769]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:15 smithi071 ceph-mon[23769]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:03:16.064 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:03:16.065 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.wait_async( 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: return future.result(timeout) 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.__get_result() 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: raise self._exception 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: raise OrchestratorError( 2024-09-17T01:03:16.066 INFO:journalctl@ceph.mon.a.smithi071.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:16.067 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.a.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.a.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:15 smithi071 ceph-mon[28615]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:15 smithi071 ceph-mon[28615]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:16.068 INFO:journalctl@ceph.mon.c.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:16.069 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.wait_async( 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:03:16.070 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: return future.result(timeout) 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.__get_result() 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: raise self._exception 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: raise OrchestratorError( 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:16.071 INFO:journalctl@ceph.mon.c.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:16.072 INFO:journalctl@ceph.mon.c.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.073 INFO:journalctl@ceph.mon.c.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:15 smithi135 ceph-mon[24697]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:15 smithi135 ceph-mon[24697]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: Creating ceph-iscsi config... 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:03:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: exec(code, run_globals) 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:03:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.wait_async( 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: return future.result(timeout) 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.__get_result() 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: raise self._exception 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:03:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout: raise OrchestratorError( 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: Creating ceph-iscsi config... 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: exec(code, run_globals) 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:03:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:03:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:03:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:03:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:03:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:03:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:03:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:03:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:03:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:16 smithi135 ceph-mon[24697]: Reconfiguring daemon agent.smithi135 on smithi135 2024-09-17T01:03:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:16 smithi135 ceph-mon[24697]: Deploying cephadm binary to smithi135 2024-09-17T01:03:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:16 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:16 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:16 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:17.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[28615]: Reconfiguring daemon agent.smithi135 on smithi135 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[28615]: Deploying cephadm binary to smithi135 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[23769]: Reconfiguring daemon agent.smithi135 on smithi135 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[23769]: Deploying cephadm binary to smithi135 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:17.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:16 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:17 smithi071 ceph-mon[23769]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:17 smithi071 ceph-mon[23769]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:03:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:17 smithi071 ceph-mon[23769]: Deploying daemon prometheus.a on smithi135 2024-09-17T01:03:18.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:17 smithi071 ceph-mon[28615]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:18.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:17 smithi071 ceph-mon[28615]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:03:18.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:17 smithi071 ceph-mon[28615]: Deploying daemon prometheus.a on smithi135 2024-09-17T01:03:18.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:17 smithi135 ceph-mon[24697]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:18.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:17 smithi135 ceph-mon[24697]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:03:18.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:17 smithi135 ceph-mon[24697]: Deploying daemon prometheus.a on smithi135 2024-09-17T01:03:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:18 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:19.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:18 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:19.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:18 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:19.866 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:19 smithi135 ceph-mon[24697]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:20.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:19 smithi071 ceph-mon[28615]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:20.048 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:19 smithi071 ceph-mon[23769]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:20.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:03:20 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:03:20.578Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.001418928s 2024-09-17T01:03:20.959 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:20] "GET /metrics HTTP/1.1" 200 38151 "" "Prometheus/2.33.4" 2024-09-17T01:03:21.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[23996]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-09-17T01:03:22.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:21 smithi071 ceph-mon[23769]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:22.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:21 smithi071 ceph-mon[28615]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:22.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:21 smithi135 ceph-mon[24697]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:03:22.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:22.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.71:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.135:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:03:24.096 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:23 smithi135 ceph-mon[24697]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:24.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:23 smithi071 ceph-mon[23769]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:24.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:23 smithi071 ceph-mon[28615]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:25.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:25 smithi135 ceph-mon[24697]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:26.080 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:25 smithi071 ceph-mon[23769]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:26.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:25 smithi071 ceph-mon[28615]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:27.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:26 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1618227836' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:03:27.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:26 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1249533039' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]: dispatch 2024-09-17T01:03:27.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:26 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]: dispatch 2024-09-17T01:03:27.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:26 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1618227836' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:03:27.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:26 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1249533039' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]: dispatch 2024-09-17T01:03:27.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:26 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]: dispatch 2024-09-17T01:03:27.176 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:26 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1618227836' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:03:27.176 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:26 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1249533039' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]: dispatch 2024-09-17T01:03:27.176 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:26 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]: dispatch 2024-09-17T01:03:28.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[23769]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:28.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]': finished 2024-09-17T01:03:28.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[23769]: osdmap e97: 8 total, 8 up, 8 in 2024-09-17T01:03:28.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1292210651' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/1025130945"}]: dispatch 2024-09-17T01:03:28.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[28615]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:28.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]': finished 2024-09-17T01:03:28.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[28615]: osdmap e97: 8 total, 8 up, 8 in 2024-09-17T01:03:28.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:27 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1292210651' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/1025130945"}]: dispatch 2024-09-17T01:03:28.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:27 smithi135 ceph-mon[24697]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:03:28.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:27 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1344998348"}]': finished 2024-09-17T01:03:28.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:27 smithi135 ceph-mon[24697]: osdmap e97: 8 total, 8 up, 8 in 2024-09-17T01:03:28.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:27 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1292210651' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/1025130945"}]: dispatch 2024-09-17T01:03:28.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 systemd[1]: Stopping Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:28.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1292210651' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/1025130945"}]': finished 2024-09-17T01:03:28.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-mon[24697]: osdmap e98: 8 total, 8 up, 8 in 2024-09-17T01:03:28.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2614935071' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]: dispatch 2024-09-17T01:03:28.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]: dispatch 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1292210651' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/1025130945"}]': finished 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[23769]: osdmap e98: 8 total, 8 up, 8 in 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2614935071' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]: dispatch 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]: dispatch 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1292210651' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/1025130945"}]': finished 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[28615]: osdmap e98: 8 total, 8 up, 8 in 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2614935071' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]: dispatch 2024-09-17T01:03:29.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:28 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]: dispatch 2024-09-17T01:03:29.256 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.983Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.983Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.983Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.983Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.983Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.983Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.984Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.984Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.984Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.984Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.984Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[43964]: ts=2024-09-17T01:03:28.984Z caller=main.go:1066 level=info msg="See you next time!" 2024-09-17T01:03:29.257 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:28 smithi135 podman[53835]: 2024-09-17 01:03:28.993938265 +0000 UTC m=+0.128229770 container died c1395755c3611790a610e504f9f9af7ae37e2a9a7d0549851835c3991110e03d (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:29.631 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:29 smithi135 podman[53835]: 2024-09-17 01:03:29.350210959 +0000 UTC m=+0.484502471 container cleanup c1395755c3611790a610e504f9f9af7ae37e2a9a7d0549851835c3991110e03d (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:29.632 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:29 smithi135 bash[53835]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T01:03:29.889 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:29 smithi135 podman[53847]: 2024-09-17 01:03:29.634714348 +0000 UTC m=+0.643031671 container remove c1395755c3611790a610e504f9f9af7ae37e2a9a7d0549851835c3991110e03d (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:29.889 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:29 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-17T01:03:29.889 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:29 smithi135 systemd[1]: Stopped Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:29.889 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:29 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service: Consumed 1.826s CPU time. 2024-09-17T01:03:29.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:29 smithi135 ceph-mon[24697]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:03:29.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:29 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]': finished 2024-09-17T01:03:29.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:29 smithi135 ceph-mon[24697]: osdmap e99: 8 total, 8 up, 8 in 2024-09-17T01:03:29.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:29 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3257477631' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]: dispatch 2024-09-17T01:03:29.890 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:29 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]: dispatch 2024-09-17T01:03:30.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[28615]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:03:30.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]': finished 2024-09-17T01:03:30.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[28615]: osdmap e99: 8 total, 8 up, 8 in 2024-09-17T01:03:30.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3257477631' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]: dispatch 2024-09-17T01:03:30.123 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]: dispatch 2024-09-17T01:03:30.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[23769]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:03:30.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/1025130945"}]': finished 2024-09-17T01:03:30.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[23769]: osdmap e99: 8 total, 8 up, 8 in 2024-09-17T01:03:30.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3257477631' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]: dispatch 2024-09-17T01:03:30.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:29 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]: dispatch 2024-09-17T01:03:30.193 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:29 smithi135 systemd[1]: Starting Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:30.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 podman[53973]: 2024-09-17 01:03:30.099779805 +0000 UTC m=+0.016814301 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-17T01:03:30.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 podman[53973]: 2024-09-17 01:03:30.211049937 +0000 UTC m=+0.128084435 container create 19350ba463a7d862207808ae987de2450bb46423f9fba8b07bf9e0da6233ab43 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:30.757 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 podman[53973]: 2024-09-17 01:03:30.471702772 +0000 UTC m=+0.388737272 container init 19350ba463a7d862207808ae987de2450bb46423f9fba8b07bf9e0da6233ab43 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:30.757 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 podman[53973]: 2024-09-17 01:03:30.474581232 +0000 UTC m=+0.391615729 container start 19350ba463a7d862207808ae987de2450bb46423f9fba8b07bf9e0da6233ab43 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:03:30.757 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.499Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.499Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.499Z caller=main.go:570 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi135 (none))" 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.499Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.499Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.500Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.501Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.502Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.502Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.504Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.504Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.763µs 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.504Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T01:03:30.758 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.505Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.522Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.523Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.523Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=18.804µs wal_replay_duration=18.306819ms wbl_replay_duration=128ns total_replay_duration=18.343069ms 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.526Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.526Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.526Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.547Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=20.874448ms db_storage=912ns remote_storage=1.195µs web_handler=449ns query_engine=760ns scrape=386.243µs scrape_sd=87.114µs notify=26.32µs notify_sd=18.08µs rules=20.027788ms tracing=7.353µs 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.547Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:30.547Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 bash[53973]: 19350ba463a7d862207808ae987de2450bb46423f9fba8b07bf9e0da6233ab43 2024-09-17T01:03:30.759 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:30 smithi135 systemd[1]: Started Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:31.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]': finished 2024-09-17T01:03:31.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-mon[24697]: osdmap e100: 8 total, 8 up, 8 in 2024-09-17T01:03:31.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/599286548' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]: dispatch 2024-09-17T01:03:31.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]: dispatch 2024-09-17T01:03:31.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:31.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:30 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]': finished 2024-09-17T01:03:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[23769]: osdmap e100: 8 total, 8 up, 8 in 2024-09-17T01:03:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/599286548' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]: dispatch 2024-09-17T01:03:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]: dispatch 2024-09-17T01:03:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:31.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1442564666"}]': finished 2024-09-17T01:03:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[28615]: osdmap e100: 8 total, 8 up, 8 in 2024-09-17T01:03:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/599286548' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]: dispatch 2024-09-17T01:03:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]: dispatch 2024-09-17T01:03:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:30 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:32.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:31 smithi135 ceph-mon[24697]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:03:32.102 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:31 smithi135 ceph-mon[24697]: Reconfiguring node-exporter.b (dependencies changed)... 2024-09-17T01:03:32.102 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:31 smithi135 ceph-mon[24697]: Deploying daemon node-exporter.b on smithi135 2024-09-17T01:03:32.102 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:31 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]': finished 2024-09-17T01:03:32.102 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:31 smithi135 ceph-mon[24697]: osdmap e101: 8 total, 8 up, 8 in 2024-09-17T01:03:32.102 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:31 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2368279544' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]: dispatch 2024-09-17T01:03:32.102 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:31 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]: dispatch 2024-09-17T01:03:32.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[28615]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:03:32.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[28615]: Reconfiguring node-exporter.b (dependencies changed)... 2024-09-17T01:03:32.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[28615]: Deploying daemon node-exporter.b on smithi135 2024-09-17T01:03:32.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]': finished 2024-09-17T01:03:32.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[28615]: osdmap e101: 8 total, 8 up, 8 in 2024-09-17T01:03:32.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2368279544' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]: dispatch 2024-09-17T01:03:32.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]: dispatch 2024-09-17T01:03:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[23769]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:03:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[23769]: Reconfiguring node-exporter.b (dependencies changed)... 2024-09-17T01:03:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[23769]: Deploying daemon node-exporter.b on smithi135 2024-09-17T01:03:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3281798392"}]': finished 2024-09-17T01:03:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[23769]: osdmap e101: 8 total, 8 up, 8 in 2024-09-17T01:03:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2368279544' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]: dispatch 2024-09-17T01:03:32.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:31 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]: dispatch 2024-09-17T01:03:32.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:32 smithi135 systemd[1]: Stopping Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:32.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:32 smithi135 podman[54245]: 2024-09-17 01:03:32.65299961 +0000 UTC m=+0.102931100 container died ce77f45249e4b449a7bcfaeb4b792bfe31fa8c3e3ba441899fa37a883aff28d7 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:03:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:32 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]': finished 2024-09-17T01:03:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:32 smithi071 ceph-mon[23769]: osdmap e102: 8 total, 8 up, 8 in 2024-09-17T01:03:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:32 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1116549784' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3095327246"}]: dispatch 2024-09-17T01:03:33.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:32 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]': finished 2024-09-17T01:03:33.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:32 smithi071 ceph-mon[28615]: osdmap e102: 8 total, 8 up, 8 in 2024-09-17T01:03:33.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:32 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1116549784' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3095327246"}]: dispatch 2024-09-17T01:03:33.182 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:32 smithi135 podman[54245]: 2024-09-17 01:03:32.967535313 +0000 UTC m=+0.417466798 container cleanup ce77f45249e4b449a7bcfaeb4b792bfe31fa8c3e3ba441899fa37a883aff28d7 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:03:33.183 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:32 smithi135 bash[54245]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b 2024-09-17T01:03:33.183 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:32 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1416703784"}]': finished 2024-09-17T01:03:33.183 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:32 smithi135 ceph-mon[24697]: osdmap e102: 8 total, 8 up, 8 in 2024-09-17T01:03:33.183 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:32 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1116549784' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3095327246"}]: dispatch 2024-09-17T01:03:33.441 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:33 smithi135 podman[54259]: 2024-09-17 01:03:33.185405148 +0000 UTC m=+0.535537830 container remove ce77f45249e4b449a7bcfaeb4b792bfe31fa8c3e3ba441899fa37a883aff28d7 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:03:33.441 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:33 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:03:33.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:33 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-17T01:03:33.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:33 smithi135 systemd[1]: Stopped Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:33.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:33 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.b.service: Consumed 3.330s CPU time. 2024-09-17T01:03:33.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:33 smithi135 systemd[1]: Starting Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:34.081 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[23769]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:03:34.081 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1116549784' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3095327246"}]': finished 2024-09-17T01:03:34.081 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[23769]: osdmap e103: 8 total, 8 up, 8 in 2024-09-17T01:03:34.081 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:34.082 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[28615]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:03:34.082 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1116549784' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3095327246"}]': finished 2024-09-17T01:03:34.082 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[28615]: osdmap e103: 8 total, 8 up, 8 in 2024-09-17T01:03:34.082 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:33 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:34.210 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:33 smithi135 bash[54383]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-17T01:03:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:33 smithi135 ceph-mon[24697]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:03:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:33 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1116549784' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/3095327246"}]': finished 2024-09-17T01:03:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:33 smithi135 ceph-mon[24697]: osdmap e103: 8 total, 8 up, 8 in 2024-09-17T01:03:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:33 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:34.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:34 smithi135 bash[54383]: Getting image source signatures 2024-09-17T01:03:34.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:34 smithi135 bash[54383]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-17T01:03:34.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:34 smithi135 bash[54383]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-17T01:03:34.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:34 smithi135 bash[54383]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-17T01:03:36.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:35 smithi071 ceph-mon[23769]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:03:36.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:35 smithi071 ceph-mon[28615]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:03:36.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:35 smithi135 ceph-mon[24697]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:03:36.152 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:35 smithi135 bash[54383]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-17T01:03:36.152 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:35 smithi135 bash[54383]: Writing manifest to image destination 2024-09-17T01:03:36.432 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 podman[54383]: 2024-09-17 01:03:36.096139037 +0000 UTC m=+2.363425118 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-17T01:03:36.432 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 podman[54383]: 2024-09-17 01:03:36.228143316 +0000 UTC m=+2.495429393 container create 1e7677cc058d70350e10de855e808288170e7e7bf2ae9a243c117edcd8cbc932 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:03:36.433 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 podman[54383]: 2024-09-17 01:03:36.43222168 +0000 UTC m=+2.699507762 container init 1e7677cc058d70350e10de855e808288170e7e7bf2ae9a243c117edcd8cbc932 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:03:36.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 podman[54383]: 2024-09-17 01:03:36.435063992 +0000 UTC m=+2.702350075 container start 1e7677cc058d70350e10de855e808288170e7e7bf2ae9a243c117edcd8cbc932 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:03:36.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.438Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-17T01:03:36.710 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.438Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.439Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.439Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.439Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=arp 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-17T01:03:36.711 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-17T01:03:36.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-17T01:03:36.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=edac 2024-09-17T01:03:36.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-17T01:03:36.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-17T01:03:36.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-17T01:03:36.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-17T01:03:36.712 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=os 2024-09-17T01:03:36.713 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=stat 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=time 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=uname 2024-09-17T01:03:36.714 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-17T01:03:36.715 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-17T01:03:36.715 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-17T01:03:36.715 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-17T01:03:36.715 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b[54456]: ts=2024-09-17T01:03:36.440Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-17T01:03:36.715 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 bash[54383]: 1e7677cc058d70350e10de855e808288170e7e7bf2ae9a243c117edcd8cbc932 2024-09-17T01:03:36.715 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:03:36 smithi135 systemd[1]: Started Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:37.100 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:36] "GET /metrics HTTP/1.1" 200 38147 "" "Prometheus/2.43.0" 2024-09-17T01:03:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-mon[24697]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:36 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:03:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[23769]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:03:37.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[28615]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:37.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:36 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:03:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:37 smithi135 ceph-mon[24697]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:37 smithi135 ceph-mon[24697]: Reconfiguring grafana.a (dependencies changed)... 2024-09-17T01:03:37.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:37 smithi135 ceph-mon[24697]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T01:03:37.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:37 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:03:37.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:37 smithi135 ceph-mon[24697]: Reconfiguring daemon grafana.a on smithi135 2024-09-17T01:03:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[23769]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:38.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[23769]: Reconfiguring grafana.a (dependencies changed)... 2024-09-17T01:03:38.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[23769]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T01:03:38.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:03:38.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[23769]: Reconfiguring daemon grafana.a on smithi135 2024-09-17T01:03:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[28615]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[28615]: Reconfiguring grafana.a (dependencies changed)... 2024-09-17T01:03:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[28615]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T01:03:38.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:03:38.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:37 smithi071 ceph-mon[28615]: Reconfiguring daemon grafana.a on smithi135 2024-09-17T01:03:38.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:38 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:38.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:03:40.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:39 smithi071 ceph-mon[23769]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 686 B/s rd, 0 op/s 2024-09-17T01:03:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:39 smithi071 ceph-mon[28615]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 686 B/s rd, 0 op/s 2024-09-17T01:03:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:39 smithi135 ceph-mon[24697]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 686 B/s rd, 0 op/s 2024-09-17T01:03:40.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:40 smithi135 systemd[1]: Stopping Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:42.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:41 smithi135 ceph-mon[24697]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:42.101 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T01:03:41+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-09-17T01:03:42.102 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[42768]: t=2024-09-17T01:03:41+0000 lvl=info msg="Database locked, sleeping then retrying" logger=sqlstore error="database is locked" retry=0 2024-09-17T01:03:42.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:41 smithi071 ceph-mon[23769]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:42.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:41 smithi071 ceph-mon[28615]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:42.414 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 podman[54836]: 2024-09-17 01:03:42.104550227 +0000 UTC m=+1.370934915 container died 8f7134c93bd0894c73500873172ae7dd78370ec7c131cdd63c8c6ec28e79161d (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, name=ubi8, vendor=Red Hat, Inc., release=236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, com.redhat.component=ubi8-container, description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-type=git, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, io.openshift.expose-services=, maintainer=Paul Cuzner , distribution-scope=public, build-date=2022-03-28T10:36:18.413762, io.openshift.tags=base rhel8, io.buildah.version=1.24.2, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182) 2024-09-17T01:03:42.700 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 podman[54836]: 2024-09-17 01:03:42.516269529 +0000 UTC m=+1.782654127 container cleanup 8f7134c93bd0894c73500873172ae7dd78370ec7c131cdd63c8c6ec28e79161d (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, distribution-scope=public, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, io.buildah.version=1.24.2, description=Ceph Grafana Container, vcs-type=git, release=236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, name=ubi8, io.openshift.tags=base rhel8, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Grafana Container configured for Ceph mgr/dashboard integration, architecture=x86_64, build-date=2022-03-28T10:36:18.413762, maintainer=Paul Cuzner ) 2024-09-17T01:03:42.700 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 bash[54836]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a 2024-09-17T01:03:42.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 podman[54913]: 2024-09-17 01:03:42.703267237 +0000 UTC m=+0.929420304 container remove 8f7134c93bd0894c73500873172ae7dd78370ec7c131cdd63c8c6ec28e79161d (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, io.openshift.tags=base rhel8, name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.expose-services=, com.redhat.component=ubi8-container, io.buildah.version=1.24.2, vcs-type=git, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, maintainer=Paul Cuzner , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=236.1648460182, vendor=Red Hat, Inc., distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, build-date=2022-03-28T10:36:18.413762, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, description=Ceph Grafana Container) 2024-09-17T01:03:42.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 bash[54948]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana.a" found: no such container 2024-09-17T01:03:42.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@grafana.a.service: Deactivated successfully. 2024-09-17T01:03:42.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 systemd[1]: Stopped Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:42.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@grafana.a.service: Consumed 2.682s CPU time. 2024-09-17T01:03:42.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:42 smithi135 systemd[1]: Starting Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:43.273 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:03:43.550 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi135\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi135\", job=\"node\", machine=\"x86_64\", nodename=\"smithi135\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi135\", job=\"node\", machine=\"x86_64\", nodename=\"smithi135\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:03:43.550 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 podman[55063]: 2024-09-17 01:03:43.188364948 +0000 UTC m=+0.016066632 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-09-17T01:03:43.550 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 podman[55063]: 2024-09-17 01:03:43.317102719 +0000 UTC m=+0.144804380 container create 76460c4e7b85aef319f42e8a86378536a76a8ffad60cf29814866312b0704e65 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, version=8.5, io.buildah.version=1.24.2, vcs-type=git, release=236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, architecture=x86_64, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, build-date=2022-03-28T10:36:18.413762, name=ubi8, description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=) 2024-09-17T01:03:43.882 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:43] ENGINE Bus STOPPING 2024-09-17T01:03:43.882 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:43] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:03:43.883 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:43] ENGINE Bus STOPPED 2024-09-17T01:03:43.883 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:43] ENGINE Bus STARTING 2024-09-17T01:03:43.883 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 podman[55063]: 2024-09-17 01:03:43.552948078 +0000 UTC m=+0.380649746 container init 76460c4e7b85aef319f42e8a86378536a76a8ffad60cf29814866312b0704e65 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, com.redhat.component=ubi8-container, architecture=x86_64, name=ubi8, description=Ceph Grafana Container, release=236.1648460182, maintainer=Paul Cuzner , build-date=2022-03-28T10:36:18.413762, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., distribution-scope=public, io.buildah.version=1.24.2, vcs-type=git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, io.openshift.expose-services=) 2024-09-17T01:03:43.883 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 podman[55063]: 2024-09-17 01:03:43.5566249 +0000 UTC m=+0.384326562 container start 76460c4e7b85aef319f42e8a86378536a76a8ffad60cf29814866312b0704e65 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, release=236.1648460182, architecture=x86_64, distribution-scope=public, io.openshift.tags=base rhel8, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, build-date=2022-03-28T10:36:18.413762, version=8.5, name=ubi8, com.redhat.component=ubi8-container, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Paul Cuzner , io.buildah.version=1.24.2) 2024-09-17T01:03:43.883 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-09-17T01:03:43.883 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-09-17T01:03:43.884 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="App mode production" logger=settings 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=725.254µs 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-09-17T01:03:43.885 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 bash[55063]: 76460c4e7b85aef319f42e8a86378536a76a8ffad60cf29814866312b0704e65 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 systemd[1]: Started Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="deleted datasource based on configuration" logger=provisioning.datasources name=Dashboard1 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Loki uid=P8E80F9AEF21F6940 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-09-17T01:03:43.886 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:03:43+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 starting - - - - 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 starting - - - - 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 starting - - - - 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 starting - - - - 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (4m) 68s ago 4m 54.8M - 3.5 e1d6a67b021e 856c169d39c9 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283 starting - - - - 2024-09-17T01:03:43.937 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:9283 running (11m) 68s ago 11m 466M - 17.2.0 e1d6a67b021e 4cb5022989e3 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (11m) 68s ago 12m 50.2M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (10m) 75s ago 10m 37.6M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (10m) 68s ago 10m 42.3M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 starting - - - - 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 starting - - - - 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (9m) 68s ago 9m 55.1M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (9m) 68s ago 9m 54.1M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (9m) 68s ago 9m 48.5M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:03:43.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (8m) 68s ago 8m 54.5M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (8m) 75s ago 8m 53.5M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (8m) 75s ago 8m 49.6M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (7m) 75s ago 7m 48.2M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (7m) 75s ago 7m 54.1M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 starting - - - - 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (4m) 68s ago 4m 72.4M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (4m) 75s ago 4m 71.0M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (4m) 68s ago 4m 70.9M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:03:43.939 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (4m) 75s ago 4m 71.1M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:03:44.144 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:43] ENGINE Serving on http://:::9283 2024-09-17T01:03:44.144 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:43] ENGINE Bus STARTED 2024-09-17T01:03:44.144 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:43] ENGINE Bus STOPPING 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi135.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:03:44.145 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.146 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:43 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:44.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:03:44.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:44.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:03:44.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi135.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi135.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:44.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:43 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:03:44.358 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:03:44.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:44] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:03:44.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:44] ENGINE Bus STOPPED 2024-09-17T01:03:44.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:44] ENGINE Bus STARTING 2024-09-17T01:03:44.700 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:03:44.700 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:03:44.701 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:03:44.701 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:03:44.701 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:03:44.701 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-17T01:03:44.701 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:03:44.701 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:03:44.701 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:03:44.811 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:44] ENGINE Serving on http://:::9283 2024-09-17T01:03:44.811 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:44] ENGINE Bus STARTED 2024-09-17T01:03:44.811 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:44] ENGINE Bus STOPPING 2024-09-17T01:03:45.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='client.25231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi135.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:44 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2699484111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:45.067 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:45] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:03:45.068 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:45] ENGINE Bus STOPPED 2024-09-17T01:03:45.068 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:45] ENGINE Bus STARTING 2024-09-17T01:03:45.116 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='client.25231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi135.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:03:45.178 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2699484111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='client.25231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi071.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi135.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:03:45.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:45.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi135.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:03:45.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:03:45.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:45.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:44 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2699484111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:45.459 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:45] ENGINE Serving on http://:::9283 2024-09-17T01:03:45.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:03:45] ENGINE Bus STARTED 2024-09-17T01:03:46.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 894 B/s rd, 0 op/s 2024-09-17T01:03:46.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:46.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1783775593' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:03:46.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 894 B/s rd, 0 op/s 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1783775593' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:46.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:03:46.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:45 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:46.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 894 B/s rd, 0 op/s 2024-09-17T01:03:46.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:46.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1783775593' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:03:46.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:46.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:46.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:46.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:03:46.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:45 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:47.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:46] "GET /metrics HTTP/1.1" 200 38147 "" "Prometheus/2.43.0" 2024-09-17T01:03:47.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:46 smithi135 ceph-mon[24697]: Upgrade: Updating mgr.y 2024-09-17T01:03:47.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:46 smithi135 ceph-mon[24697]: Deploying daemon mgr.y on smithi071 2024-09-17T01:03:47.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:46 smithi135 ceph-mon[24697]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:47.255 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:46 smithi071 systemd[1]: Stopping Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:47.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:46 smithi071 ceph-mon[28615]: Upgrade: Updating mgr.y 2024-09-17T01:03:47.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:46 smithi071 ceph-mon[28615]: Deploying daemon mgr.y on smithi071 2024-09-17T01:03:47.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:46 smithi071 ceph-mon[28615]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:47.256 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:46 smithi071 ceph-mon[23769]: Upgrade: Updating mgr.y 2024-09-17T01:03:47.256 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:46 smithi071 ceph-mon[23769]: Deploying daemon mgr.y on smithi071 2024-09-17T01:03:47.256 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:46 smithi071 ceph-mon[23769]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:47.524 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:47 smithi071 podman[65490]: 2024-09-17 01:03:47.257322928 +0000 UTC m=+0.149774483 container died 4cb5022989e37531ea493fae7cdacf6964610f1b10f5c08e157036aaff76e051 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_CLEAN=True, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, architecture=x86_64, io.buildah.version=1.19.8, io.openshift.expose-services=, distribution-scope=public, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0) 2024-09-17T01:03:47.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:47 smithi071 podman[65490]: 2024-09-17 01:03:47.617940635 +0000 UTC m=+0.510392185 container cleanup 4cb5022989e37531ea493fae7cdacf6964610f1b10f5c08e157036aaff76e051 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, release=754, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., version=8, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, ceph=True, name=centos-stream, com.redhat.component=centos-stream-container, architecture=x86_64, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , vcs-type=git, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public) 2024-09-17T01:03:47.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:47 smithi071 bash[65490]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y 2024-09-17T01:03:48.184 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:47 smithi071 ceph-mon[23769]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:48.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:47 smithi071 ceph-mon[28615]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:48.184 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 podman[65502]: 2024-09-17 01:03:48.061580388 +0000 UTC m=+0.804097761 container remove 4cb5022989e37531ea493fae7cdacf6964610f1b10f5c08e157036aaff76e051 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, version=8, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, com.redhat.component=centos-stream-container, distribution-scope=public, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, ceph=True, GIT_BRANCH=HEAD, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux ) 2024-09-17T01:03:48.184 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:03:48.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:47 smithi135 ceph-mon[24697]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:48.612 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-17T01:03:48.613 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 systemd[1]: Stopped Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:48.613 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Consumed 1min 1.618s CPU time. 2024-09-17T01:03:48.613 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 systemd[1]: Starting Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:03:48.887 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 podman[65631]: 2024-09-17 01:03:48.518460216 +0000 UTC m=+0.015684398 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:03:48.887 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 podman[65631]: 2024-09-17 01:03:48.647306552 +0000 UTC m=+0.144530769 container create c23b8f0354b9ca169e2bc278e2b5409a094f92bdac8492c0b819e7df36377f9b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T01:03:48.914 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:48.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:03:49.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:48 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:49.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:48 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:49.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 podman[65631]: 2024-09-17 01:03:48.890199227 +0000 UTC m=+0.387423408 container init c23b8f0354b9ca169e2bc278e2b5409a094f92bdac8492c0b819e7df36377f9b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:03:49.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 podman[65631]: 2024-09-17 01:03:48.893548909 +0000 UTC m=+0.390773081 container start c23b8f0354b9ca169e2bc278e2b5409a094f92bdac8492c0b819e7df36377f9b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-17T01:03:49.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 ceph-mgr[65651]: -- 172.21.15.71:0/2821820975 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1db7f30e0 con 0x55f1db7d0800 2024-09-17T01:03:49.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 bash[65631]: c23b8f0354b9ca169e2bc278e2b5409a094f92bdac8492c0b819e7df36377f9b 2024-09-17T01:03:49.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:48 smithi071 systemd[1]: Started Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:03:49.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.016+0000 7fe46079d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:03:49.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.078+0000 7fe46079d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:03:49.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:48 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:49.508 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.244+0000 7fe46079d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:03:49.508 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.313+0000 7fe46079d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:03:49.508 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.465+0000 7fe46079d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:03:49.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.610+0000 7fe46079d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[28615]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:03:50.195 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.932+0000 7fe46079d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:49.995+0000 7fe46079d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[23769]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:50.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:03:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:50 smithi135 ceph-mon[24697]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:50.313 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:50.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:50.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:50 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:50.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:50 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:03:50.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:03:50.314 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:50 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:03:50.455 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:50.196+0000 7fe46079d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:03:51.168 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:51 smithi135 ceph-mon[24697]: Deploying daemon agent.smithi135 on smithi135 2024-09-17T01:03:51.168 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:51 smithi135 ceph-mon[24697]: Deploying daemon agent.smithi071 on smithi071 2024-09-17T01:03:51.168 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:51 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.168 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:51 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.168 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:51 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.168 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:51 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[23769]: Deploying daemon agent.smithi135 on smithi135 2024-09-17T01:03:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[23769]: Deploying daemon agent.smithi071 on smithi071 2024-09-17T01:03:51.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.398 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:51.196+0000 7fe46079d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:03:51.399 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:51.266+0000 7fe46079d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:03:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[28615]: Deploying daemon agent.smithi135 on smithi135 2024-09-17T01:03:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[28615]: Deploying daemon agent.smithi071 on smithi071 2024-09-17T01:03:51.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:51.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:51 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:52.300 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-mon[28615]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:52.300 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-mon[23769]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:52.301 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.022+0000 7fe46079d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:03:52.301 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.152+0000 7fe46079d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:03:52.436 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:52 smithi135 ceph-mon[24697]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:52.571 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.301+0000 7fe46079d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:03:52.571 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.370+0000 7fe46079d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:03:52.890 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.574+0000 7fe46079d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:03:52.891 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.667+0000 7fe46079d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:03:52.891 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.747+0000 7fe46079d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:03:53.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.908+0000 7fe46079d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:03:53.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:52.978+0000 7fe46079d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:03:53.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:53.049+0000 7fe46079d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:03:53.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:53.131+0000 7fe46079d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:53.421 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:53.422 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:53.422 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:03:53.422 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.446 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:53.192+0000 7fe46079d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:53.251+0000 7fe46079d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:53.447 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:03:53.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:53.449 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:03:53.449 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:53.449 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:03:53.449 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:53 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:53.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:53.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:03:54.343 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:54.080+0000 7fe46079d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:03:54.343 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:03:54] ENGINE Bus STARTING 2024-09-17T01:03:54.343 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: CherryPy Checker: 2024-09-17T01:03:54.343 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: The Application mounted at '' has an empty config. 2024-09-17T01:03:54.344 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:03:54.344 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:03:54] ENGINE Serving on http://:::9283 2024-09-17T01:03:54.344 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:03:54] ENGINE Bus STARTED 2024-09-17T01:03:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:54 smithi135 ceph-mon[24697]: Standby manager daemon y restarted 2024-09-17T01:03:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:54 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:03:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:54 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:03:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:54 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:54 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:03:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:54 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:55.113 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[23769]: Standby manager daemon y restarted 2024-09-17T01:03:55.113 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:03:55.113 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:03:55.113 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[28615]: Standby manager daemon y restarted 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:03:55.114 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:54 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:55.849 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:55 smithi071 ceph-mon[23769]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:55.849 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:55 smithi071 ceph-mon[23769]: mgrmap e26: x(active, since 66s), standbys: y 2024-09-17T01:03:55.849 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:55 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:55.850 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:55 smithi071 ceph-mon[28615]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:55.850 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:55 smithi071 ceph-mon[28615]: mgrmap e26: x(active, since 66s), standbys: y 2024-09-17T01:03:55.850 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:55 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:56.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:55 smithi135 ceph-mon[24697]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:03:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:55 smithi135 ceph-mon[24697]: mgrmap e26: x(active, since 66s), standbys: y 2024-09-17T01:03:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:55 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:56.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:56 smithi071 ceph-mon[23769]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:56.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:56 smithi071 ceph-mon[28615]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:57.026 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:56 smithi135 ceph-mon[24697]: from='client.25171 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:03:57.026 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:03:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:03:56] "GET /metrics HTTP/1.1" 200 38148 "" "Prometheus/2.43.0" 2024-09-17T01:03:58.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[28615]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:58.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.306 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[23769]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:58.306 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.306 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.306 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:03:58 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:58 smithi135 ceph-mon[24697]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:03:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:58 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:58 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:03:58 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:03:58.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:03:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:03:58.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:00.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:00 smithi071 ceph-mon[23769]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:04:00.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:00 smithi071 ceph-mon[28615]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:04:00.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:00 smithi135 ceph-mon[24697]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:04:02.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:01] ENGINE Bus STOPPING 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:04:02.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: Failing over to other MGR 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: osdmap e104: 8 total, 8 up, 8 in 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/46794044' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:04:02.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: Failing over to other MGR 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: osdmap e104: 8 total, 8 up, 8 in 2024-09-17T01:04:02.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:01 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/46794044' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:02.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:01.885+0000 7fae664f2640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-17T01:04:02.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ignoring --setuser ceph since I am not root 2024-09-17T01:04:02.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: ignoring --setgroup ceph since I am not root 2024-09-17T01:04:02.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mgr[50442]: -- 172.21.15.135:0/3530017905 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df820270e0 con 0x55df82004800 2024-09-17T01:04:02.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.029+0000 7f35be41b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:04:02.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.085+0000 7f35be41b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.x) 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: Failing over to other MGR 2024-09-17T01:04:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mgr.24932 172.21.15.135:0/4173922773' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-17T01:04:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-17T01:04:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: osdmap e104: 8 total, 8 up, 8 in 2024-09-17T01:04:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:01 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/46794044' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:02.527 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:02] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:04:02.527 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:02] ENGINE Bus STOPPED 2024-09-17T01:04:02.527 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:02] ENGINE Bus STARTING 2024-09-17T01:04:02.527 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:02] ENGINE Serving on http://:::9283 2024-09-17T01:04:02.527 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:02] ENGINE Bus STARTED 2024-09-17T01:04:02.589 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.232+0000 7f35be41b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:04:02.589 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.300+0000 7f35be41b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:04:02.589 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.448+0000 7f35be41b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:02.589 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.590+0000 7f35be41b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.24932 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: mgrmap e27: y(active, starting, since 0.953798s) 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:04:03.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: Manager daemon y is now available 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:03.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.24932 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: mgrmap e27: y(active, starting, since 0.953798s) 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:04:03.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: Manager daemon y is now available 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:03.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:02 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:03.151 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.905+0000 7f35be41b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:04:03.151 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:02.967+0000 7f35be41b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:04:03.151 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:03.152+0000 7f35be41b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:04:03.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.24932 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-17T01:04:03.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: mgrmap e27: y(active, starting, since 0.953798s) 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:04:03.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: Manager daemon y is now available 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:03.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:02 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:03.895 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:03.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[28615]: mgrmap e28: y(active, since 1.96226s) 2024-09-17T01:04:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[28615]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:04.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[23769]: mgrmap e28: y(active, since 1.96226s) 2024-09-17T01:04:04.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[23769]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:04.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:04.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:04.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:04.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:03 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-mon[24697]: mgrmap e28: y(active, since 1.96226s) 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-mon[24697]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:03 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:04.081+0000 7f35be41b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:04:04.152 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:04.154+0000 7f35be41b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:04:04.490 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:04.312+0000 7fe3be059640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:01:04:04] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:04.490 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: Traceback (most recent call last): 2024-09-17T01:04:04.490 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: self._connections.run(self.expiration_interval) 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: self._run(expiration_interval) 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: s = self.context.wrap_socket( 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: return self.sslsocket_class._create( 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:04.491 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: self.do_handshake() 2024-09-17T01:04:04.492 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:04.492 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: self._sslobj.do_handshake() 2024-09-17T01:04:04.492 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:04.492 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:04.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:04:05.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:05.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:04 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:05.252 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:04.965+0000 7f35be41b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:04:05.252 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.094+0000 7f35be41b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:04:05.252 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.253+0000 7f35be41b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:05.542 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.320+0000 7f35be41b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:04:05.543 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.476+0000 7f35be41b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:04:05.543 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.544+0000 7f35be41b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:04:05.842 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.607+0000 7f35be41b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:04:05.842 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.774+0000 7f35be41b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:04:06.121 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.844+0000 7f35be41b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:04:06.121 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:05.914+0000 7f35be41b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:04:06.121 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:06.000+0000 7f35be41b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:06.122 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:06.061+0000 7f35be41b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:04:06.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:06.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:06.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:04] ENGINE Bus STARTING 2024-09-17T01:04:06.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:06.122 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:04] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:04] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._run(expiration_interval) 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:06.123 INFO:journalctl@ceph.mon.b.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: s = self.context.wrap_socket( 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.sslsocket_class._create( 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: self.do_handshake() 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._sslobj.do_handshake() 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:04] ENGINE Serving on http://172.21.15.71:8765 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:04] ENGINE Bus STARTED 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:06.124 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: mgrmap e29: y(active, since 4s) 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.125 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:05 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:04] ENGINE Bus STARTING 2024-09-17T01:04:06.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:04] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:04] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:06.147 INFO:journalctl@ceph.mon.a.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: self.do_handshake() 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:06.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:04] ENGINE Serving on http://172.21.15.71:8765 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:04] ENGINE Bus STARTED 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: mgrmap e29: y(active, since 4s) 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:06.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:06.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:04] ENGINE Bus STARTING 2024-09-17T01:04:06.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:06.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:04] ENGINE Serving on https://172.21.15.71:7150 2024-09-17T01:04:06.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:04] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:04:06.151 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.do_handshake() 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:04] ENGINE Serving on http://172.21.15.71:8765 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:04] ENGINE Bus STARTED 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:06.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: mgrmap e29: y(active, since 4s) 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:05 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:06.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:06.123+0000 7f35be41b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:04:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[28615]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[23769]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:07.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:06 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:06 smithi135 ceph-mon[24697]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:06 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:06 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:06 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:06.999+0000 7f35be41b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:04:07] ENGINE Bus STARTING 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: CherryPy Checker: 2024-09-17T01:04:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: The Application mounted at '' has an empty config. 2024-09-17T01:04:07.211 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: 2024-09-17T01:04:07.211 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:04:07] ENGINE Serving on http://:::9283 2024-09-17T01:04:07.211 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[50438]: [17/Sep/2024:01:04:07] ENGINE Bus STARTED 2024-09-17T01:04:08.158 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: mgrmap e30: y(active, since 5s) 2024-09-17T01:04:08.158 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: Standby manager daemon x started 2024-09-17T01:04:08.158 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:04:08.158 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:08.158 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:04:08.158 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:08.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.159 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:07 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: mgrmap e30: y(active, since 5s) 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: Standby manager daemon x started 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.181 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: mgrmap e30: y(active, since 5s) 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: Standby manager daemon x started 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/799027211' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:08.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.183 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.183 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.183 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.183 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:08.183 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:07 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:09.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:08 smithi071 ceph-mon[28615]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:09.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:08 smithi071 ceph-mon[28615]: mgrmap e31: y(active, since 6s), standbys: x 2024-09-17T01:04:09.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:08 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:04:09.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:08 smithi071 ceph-mon[23769]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:09.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:08 smithi071 ceph-mon[23769]: mgrmap e31: y(active, since 6s), standbys: x 2024-09-17T01:04:09.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:08 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:04:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:08 smithi135 ceph-mon[24697]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:08 smithi135 ceph-mon[24697]: mgrmap e31: y(active, since 6s), standbys: x 2024-09-17T01:04:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:08 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:04:10.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:09 smithi071 ceph-mon[23769]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:04:10.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:09 smithi071 ceph-mon[28615]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:04:10.166 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:09 smithi135 ceph-mon[24697]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:04:11.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:11 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:11 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:11 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:11 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:11 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:11 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:11 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:11 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:11 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:12.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:12 smithi071 ceph-mon[23769]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:04:12.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:12 smithi071 ceph-mon[28615]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:04:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:12 smithi135 ceph-mon[24697]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:04:13.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:13 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:13.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:13 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:13.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:13 smithi135 ceph-mon[24697]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:04:13.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:13 smithi135 ceph-mon[24697]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T01:04:13.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:13 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3201565326' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:13.829 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:13.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[23769]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:04:13.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[23769]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T01:04:13.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3201565326' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[28615]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:04:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[28615]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T01:04:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:13 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3201565326' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[28615]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:04:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[23769]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:04:14.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:14 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:14 smithi135 ceph-mon[24697]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:04:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:14 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:14 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:14 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:15.470 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 1s ago 11m - - 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 5s ago 11m - - 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (66s) 1s ago 6m 15.4M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (32s) 5s ago 6m 42.2M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (16s) 1s ago 4m 44.2M - 3.5 e1d6a67b021e 4ff1ea1ba7d8 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283 running (93s) 5s ago 10m 379M - 19.1.1-330-gc2ddf972 ebb0615149de 0231b65a2145 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (27s) 1s ago 12m 487M - 19.1.1-330-gc2ddf972 ebb0615149de c23b8f0354b9 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (12m) 1s ago 12m 58.0M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (11m) 5s ago 11m 49.8M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:04:16.121 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (11m) 1s ago 11m 53.9M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (76s) 1s ago 6m 8363k - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (40s) 5s ago 6m 8493k - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (10m) 1s ago 10m 56.2M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (10m) 1s ago 10m 54.9M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (9m) 1s ago 9m 49.6M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (9m) 1s ago 9m 55.1M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (8m) 5s ago 8m 55.5M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (8m) 5s ago 8m 51.4M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (8m) 5s ago 8m 49.2M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (7m) 5s ago 7m 56.2M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (46s) 5s ago 7m 47.3M - 2.43.0 a07b618ecd1d 19350ba463a7 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (5m) 1s ago 5m 74.7M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (5m) 5s ago 5m 72.8M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (4m) 1s ago 4m 72.7M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:04:16.122 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (4m) 5s ago 4m 73.0M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:04:16.201 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:15 smithi135 systemd[1]: Stopping Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:16.201 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:15 smithi135 ceph-mon[24697]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:16.201 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:15 smithi135 ceph-mon[24697]: from='client.25348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:16.201 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:15 smithi135 ceph-mon[24697]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:16.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:15 smithi071 ceph-mon[28615]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:16.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:15 smithi071 ceph-mon[28615]: from='client.25348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:16.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:15 smithi071 ceph-mon[28615]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:15 smithi071 ceph-mon[23769]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:15 smithi071 ceph-mon[23769]: from='client.25348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:15 smithi071 ceph-mon[23769]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T01:04:16.460 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.203Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-17T01:04:16.461 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.204Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-17T01:04:16.461 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.204Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T01:04:16.461 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.204Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-17T01:04:16.461 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[53988]: ts=2024-09-17T01:04:16.204Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-17T01:04:16.461 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 podman[58210]: 2024-09-17 01:04:16.213552857 +0000 UTC m=+0.099172508 container died 19350ba463a7d862207808ae987de2450bb46423f9fba8b07bf9e0da6233ab43 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:04:16.516 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:04:16.517 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr" 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:04:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "", 2024-09-17T01:04:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:04:16.853 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:04:16.894 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 podman[58210]: 2024-09-17 01:04:16.579085298 +0000 UTC m=+0.464704991 container cleanup 19350ba463a7d862207808ae987de2450bb46423f9fba8b07bf9e0da6233ab43 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:16.894 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 bash[58210]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T01:04:17.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-mon[24697]: from='client.25354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:17.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1371537698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:17.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:16 smithi135 ceph-mon[24697]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:17.054 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:16 smithi135 podman[58222]: 2024-09-17 01:04:16.897106086 +0000 UTC m=+0.685254112 container remove 19350ba463a7d862207808ae987de2450bb46423f9fba8b07bf9e0da6233ab43 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:17.054 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-17T01:04:17.054 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 systemd[1]: Stopped Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:17.054 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service: Consumed 1.190s CPU time. 2024-09-17T01:04:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:16 smithi071 ceph-mon[23769]: from='client.25354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:16 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1371537698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:17.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:16 smithi071 ceph-mon[23769]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:16 smithi071 ceph-mon[28615]: from='client.25354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:17.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:16 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1371537698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:17.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:16 smithi071 ceph-mon[28615]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:17.209 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 systemd[1]: Starting Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:17.248 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:04:17.548 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 podman[58315]: 2024-09-17 01:04:17.1645129 +0000 UTC m=+0.016730412 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-17T01:04:17.548 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 podman[58315]: 2024-09-17 01:04:17.307112591 +0000 UTC m=+0.159330080 container create cd1d499f251acddaaf37b5a1cf5945590abbf51aa2c21fa50044a516a5a201a2 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:17.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 podman[58315]: 2024-09-17 01:04:17.551564889 +0000 UTC m=+0.403782391 container init cd1d499f251acddaaf37b5a1cf5945590abbf51aa2c21fa50044a516a5a201a2 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:17.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 podman[58315]: 2024-09-17 01:04:17.554412982 +0000 UTC m=+0.406630479 container start cd1d499f251acddaaf37b5a1cf5945590abbf51aa2c21fa50044a516a5a201a2 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:17.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.578Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-17T01:04:17.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.578Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-17T01:04:17.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.578Z caller=main.go:570 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi135 (none))" 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.578Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.578Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.580Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.580Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.581Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.581Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.583Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.583Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.922µs 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.583Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.584Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.599Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.604Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-09-17T01:04:17.961 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.605Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.605Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=24.581µs wal_replay_duration=21.67635ms wbl_replay_duration=123ns total_replay_duration=21.718896ms 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.610Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.610Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.610Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.628Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.483529ms db_storage=733ns remote_storage=976ns web_handler=415ns query_engine=1.09µs scrape=396.387µs scrape_sd=116.652µs notify=17.575µs notify_sd=22.853µs rules=17.622394ms tracing=5.102µs 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.628Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:17.628Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 bash[58315]: cd1d499f251acddaaf37b5a1cf5945590abbf51aa2c21fa50044a516a5a201a2 2024-09-17T01:04:17.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:17 smithi135 systemd[1]: Started Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:18.244 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4207985400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:04:18.244 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: Adding iSCSI gateway http://:@172.21.15.71:5000 to Dashboard 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:18.245 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:18.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:18.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:18.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:18.246 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:17 smithi135 ceph-mon[24697]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:18.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4207985400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:04:18.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:18.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: Adding iSCSI gateway http://:@172.21.15.71:5000 to Dashboard 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:18.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[28615]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4207985400' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: Adding iSCSI gateway http://:@172.21.15.71:5000 to Dashboard 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi071"}]: dispatch 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:17 smithi071 ceph-mon[23769]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:20.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:19 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:20.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:19 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:04:20.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:19 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:20.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:19 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:20.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:19 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:04:20.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:19 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:20.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:19 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:20.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:19 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:04:20.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:19 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:20.749 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:20 smithi135 systemd[1]: Stopping Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:21.027 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:20 smithi135 ceph-mon[24697]: Upgrade: Updating mgr.x 2024-09-17T01:04:21.027 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:20 smithi135 ceph-mon[24697]: Deploying daemon mgr.x on smithi135 2024-09-17T01:04:21.027 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:20 smithi135 ceph-mon[24697]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:21.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:20 smithi071 ceph-mon[23769]: Upgrade: Updating mgr.x 2024-09-17T01:04:21.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:20 smithi071 ceph-mon[23769]: Deploying daemon mgr.x on smithi135 2024-09-17T01:04:21.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:20 smithi071 ceph-mon[23769]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:21.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:20 smithi071 ceph-mon[28615]: Upgrade: Updating mgr.x 2024-09-17T01:04:21.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:20 smithi071 ceph-mon[28615]: Deploying daemon mgr.x on smithi135 2024-09-17T01:04:21.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:20 smithi071 ceph-mon[28615]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:04:21.280 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 podman[58651]: 2024-09-17 01:04:21.030090943 +0000 UTC m=+0.133230866 container died 0231b65a214507ccb47c42a05310a88becd0f129d255ebcdd851408cece29032 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:04:21.531 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 podman[58651]: 2024-09-17 01:04:21.374053646 +0000 UTC m=+0.477193569 container cleanup 0231b65a214507ccb47c42a05310a88becd0f129d255ebcdd851408cece29032 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:04:21.532 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 bash[58651]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x 2024-09-17T01:04:21.842 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 podman[58664]: 2024-09-17 01:04:21.534281496 +0000 UTC m=+0.500196217 container remove 0231b65a214507ccb47c42a05310a88becd0f129d255ebcdd851408cece29032 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:04:21.842 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:04:21.843 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-09-17T01:04:21.843 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 systemd[1]: Stopped Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:21.843 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service: Consumed 21.969s CPU time. 2024-09-17T01:04:22.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:21 smithi135 ceph-mon[24697]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:04:22.154 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:21 smithi135 systemd[1]: Starting Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:22.334 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:21 smithi071 ceph-mon[23769]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:04:22.334 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:21 smithi071 ceph-mon[28615]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:04:22.405 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 podman[58794]: 2024-09-17 01:04:22.05957913 +0000 UTC m=+0.015832767 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:04:22.406 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 podman[58794]: 2024-09-17 01:04:22.194191224 +0000 UTC m=+0.150444860 container create 6449f418a604cc0cd1044ff2fe369a7d7b56ff6780fc3bb8bdaf0ad109578755 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-17T01:04:22.406 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 podman[58794]: 2024-09-17 01:04:22.405762822 +0000 UTC m=+0.362016458 container init 6449f418a604cc0cd1044ff2fe369a7d7b56ff6780fc3bb8bdaf0ad109578755 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:04:22.406 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 podman[58794]: 2024-09-17 01:04:22.408566579 +0000 UTC m=+0.364820226 container start 6449f418a604cc0cd1044ff2fe369a7d7b56ff6780fc3bb8bdaf0ad109578755 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-17T01:04:22.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 ceph-mgr[58814]: -- 172.21.15.135:0/2806873890 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dcfafaf0e0 con 0x55dcfaf8c800 2024-09-17T01:04:22.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 bash[58794]: 6449f418a604cc0cd1044ff2fe369a7d7b56ff6780fc3bb8bdaf0ad109578755 2024-09-17T01:04:22.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 systemd[1]: Started Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:22.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:22.527+0000 7fce9dfe4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:04:22.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:22.589+0000 7fce9dfe4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:23.095 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:22.744+0000 7fce9dfe4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:04:23.096 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:22.810+0000 7fce9dfe4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:04:23.096 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:22.958+0000 7fce9dfe4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:23.096 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:23.097+0000 7fce9dfe4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:04:23.659 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:23.410+0000 7fce9dfe4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:04:23.659 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:23.470+0000 7fce9dfe4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:04:23.660 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:23.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:23.660 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.660 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.660 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:23.660 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:23.660 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.660 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:23.661 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:23.661 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:23.661 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:23.661 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: Failing over to other MGR 2024-09-17T01:04:23.661 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:04:23.661 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: osdmap e105: 8 total, 8 up, 8 in 2024-09-17T01:04:23.661 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-mon[24697]: from='client.25327 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:23.587+0000 7fe45b72e640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: ignoring --setuser ceph since I am not root 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: ignoring --setgroup ceph since I am not root 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mgr[65651]: -- 172.21.15.71:0/775262340 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643880010e0 con 0x564387fde800 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:23.733+0000 7f45b5c40040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:23.803+0000 7f45b5c40040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: Failing over to other MGR 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: osdmap e105: 8 total, 8 up, 8 in 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[23769]: from='client.25327 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:04:23.803 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: Upgrade: Need to upgrade myself (mgr.y) 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: Failing over to other MGR 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: osdmap e105: 8 total, 8 up, 8 in 2024-09-17T01:04:23.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-mon[28615]: from='client.25327 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:04:23.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:23.661+0000 7fce9dfe4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:04:24.125 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:23.955+0000 7f45b5c40040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:04:24.125 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:24.023+0000 7f45b5c40040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:04:24.399 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:24.177+0000 7f45b5c40040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:24.400 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:24.320+0000 7f45b5c40040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:04:24.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-mon[28615]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-17T01:04:24.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-mon[28615]: mgrmap e32: x(active, starting, since 0.891693s) 2024-09-17T01:04:24.669 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-mon[23769]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-17T01:04:24.669 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-mon[23769]: mgrmap e32: x(active, starting, since 0.891693s) 2024-09-17T01:04:24.945 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:24.671+0000 7f45b5c40040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:04:24.945 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:24.742+0000 7f45b5c40040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:04:24.945 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:24.946+0000 7f45b5c40040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:04:24.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:24 smithi135 ceph-mon[24697]: from='mgr.15354 172.21.15.71:0/3034616212' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-09-17T01:04:24.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:24 smithi135 ceph-mon[24697]: mgrmap e32: x(active, starting, since 0.891693s) 2024-09-17T01:04:24.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:24.572+0000 7fce9dfe4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:04:24.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:24.645+0000 7fce9dfe4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:04:25.538 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:25.422+0000 7fce9dfe4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:04:25.539 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:25.540+0000 7fce9dfe4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:04:25.913 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:25.691+0000 7fce9dfe4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:25.913 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:25.763+0000 7fce9dfe4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:04:25.913 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:25.915+0000 7fce9dfe4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:04:26.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:25.857+0000 7f45b5c40040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:04:26.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:25 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:25.924+0000 7f45b5c40040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:25.987+0000 7fce9dfe4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:04:26.178 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:26.052+0000 7fce9dfe4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:04:26.438 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:26.213+0000 7fce9dfe4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:04:26.438 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:26.278+0000 7fce9dfe4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:04:26.438 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:26.346+0000 7fce9dfe4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:04:26.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:26.440+0000 7fce9dfe4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:26.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:26.508+0000 7fce9dfe4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:04:26.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:26.575+0000 7fce9dfe4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:04:26.936 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:26.669+0000 7f45b5c40040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:04:26.936 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:26.791+0000 7f45b5c40040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:04:27.222 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:26.937+0000 7f45b5c40040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:27.222 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.001+0000 7f45b5c40040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:04:27.222 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.152+0000 7f45b5c40040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:04:27.223 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.223+0000 7f45b5c40040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:04:27.483 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.284+0000 7f45b5c40040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:04:27.483 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.453+0000 7f45b5c40040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:04:27.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-mon[24697]: Active manager daemon x restarted 2024-09-17T01:04:27.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-mon[24697]: Activating manager daemon x 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-mon[24697]: osdmap e106: 8 total, 8 up, 8 in 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:27.423+0000 7fce9dfe4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Bus STARTING 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: CherryPy Checker: 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: The Application mounted at '' has an empty config. 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:27.671 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Serving on http://:::9283 2024-09-17T01:04:27.672 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Bus STARTED 2024-09-17T01:04:27.672 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Bus STOPPING 2024-09-17T01:04:27.672 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:04:27.672 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Bus STOPPED 2024-09-17T01:04:27.748 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.525+0000 7f45b5c40040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.597+0000 7f45b5c40040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.686+0000 7f45b5c40040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.749+0000 7f45b5c40040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[23769]: Active manager daemon x restarted 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[23769]: Activating manager daemon x 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[23769]: osdmap e106: 8 total, 8 up, 8 in 2024-09-17T01:04:27.749 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[28615]: Active manager daemon x restarted 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[28615]: Activating manager daemon x 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[28615]: osdmap e106: 8 total, 8 up, 8 in 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T01:04:27.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:27.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Bus STARTING 2024-09-17T01:04:27.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Serving on http://:::9283 2024-09-17T01:04:27.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:04:27] ENGINE Bus STARTED 2024-09-17T01:04:28.041 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:27.811+0000 7f45b5c40040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:04:28.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:04:28.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: mgrmap e33: x(active, starting, since 0.0577984s) 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:04:28.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: Manager daemon x is now available 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:28.618 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:28.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: mgrmap e33: x(active, starting, since 0.0577984s) 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:04:28.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: Manager daemon x is now available 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:28.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:28.623 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: mgrmap e33: x(active, starting, since 0.0577984s) 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:04:28.746 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: Manager daemon x is now available 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:28.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:28.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:28.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:28.664+0000 7f45b5c40040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:04:28.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:28] ENGINE Bus STARTING 2024-09-17T01:04:28.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: CherryPy Checker: 2024-09-17T01:04:28.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: The Application mounted at '' has an empty config. 2024-09-17T01:04:28.897 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: 2024-09-17T01:04:28.897 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:28] ENGINE Serving on http://:::9283 2024-09-17T01:04:28.897 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: [17/Sep/2024:01:04:28] ENGINE Bus STARTED 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: mgrmap e34: x(active, since 1.07166s) 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:04:29.624 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:29] ENGINE Bus STARTING 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:29] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:29.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: mgrmap e34: x(active, since 1.07166s) 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:29] ENGINE Bus STARTING 2024-09-17T01:04:29.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:29.627 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:29] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:04:29.627 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:29.627 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-mon[23769]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:29.627 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:04:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-17T01:04:29.697 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: mgrmap e34: x(active, since 1.07166s) 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/3485153118' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:29.698 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:29] ENGINE Bus STARTING 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:29] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:29.447+0000 7fcdf4792640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:01:04:29] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:29.699 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:04:29.700 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:29.700 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self._connections.run(self.expiration_interval) 2024-09-17T01:04:29.700 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:29.700 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self._run(expiration_interval) 2024-09-17T01:04:29.700 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:29.700 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:29.700 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: s = self.context.wrap_socket( 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.sslsocket_class._create( 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self.do_handshake() 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:29.701 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self._sslobj.do_handshake() 2024-09-17T01:04:29.702 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:29.702 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:29 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:30.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:29] ENGINE Serving on https://172.21.15.135:7151 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:29] ENGINE Bus STARTED 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: [17/Sep/2024:01:04:29] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: self.do_handshake() 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:04:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:04:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: mgrmap e35: x(active, since 2s), standbys: y 2024-09-17T01:04:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:30.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[23769]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:29] ENGINE Serving on https://172.21.15.135:7151 2024-09-17T01:04:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:29] ENGINE Bus STARTED 2024-09-17T01:04:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: [17/Sep/2024:01:04:29] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:04:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.do_handshake() 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: mgrmap e35: x(active, since 2s), standbys: y 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:30.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:30.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:30.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:30.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:30.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:30.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:30 smithi071 ceph-mon[28615]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:30.828 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:29] ENGINE Serving on https://172.21.15.135:7151 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:29] ENGINE Bus STARTED 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: [17/Sep/2024:01:04:29] ENGINE Error in HTTPServer.serve 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._run(expiration_interval) 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:04:30.829 INFO:journalctl@ceph.mon.b.smithi135.stdout: s = self.context.wrap_socket( 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.sslsocket_class._create( 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout: self.do_handshake() 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._sslobj.do_handshake() 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: mgrmap e35: x(active, since 2s), standbys: y 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.830 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:30.831 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:30 smithi135 ceph-mon[24697]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:32.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:33.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:33 smithi135 ceph-mon[24697]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:33 smithi135 ceph-mon[24697]: mgrmap e36: x(active, since 4s), standbys: y 2024-09-17T01:04:33.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:33 smithi071 ceph-mon[23769]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:33.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:33 smithi071 ceph-mon[23769]: mgrmap e36: x(active, since 4s), standbys: y 2024-09-17T01:04:33.275 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:33 smithi071 ceph-mon[28615]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:33.275 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:33 smithi071 ceph-mon[28615]: mgrmap e36: x(active, since 4s), standbys: y 2024-09-17T01:04:33.581 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:33 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:33.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:34.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:34 smithi135 ceph-mon[24697]: from='client.25327 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:04:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.322 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[23769]: from='client.25327 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:04:34.322 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.322 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.323 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.323 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[28615]: from='client.25327 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:04:34.323 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.323 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:34.323 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:35.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:35 smithi071 ceph-mon[28615]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:35.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:35 smithi071 ceph-mon[28615]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:04:35.392 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:35 smithi071 ceph-mon[23769]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:35.392 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:35 smithi071 ceph-mon[23769]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:04:35.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-mon[24697]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:35.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-mon[24697]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:04:35.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:35.114+0000 7fce2e2c2640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:35.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Creating ceph-iscsi config... 2024-09-17T01:04:35.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:35.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:35.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return _run_code(code, main_globals, None, 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: exec(code, run_globals) 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:35.461 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:35.462 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.wait_async( 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return future.result(timeout) 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.__get_result() 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: raise self._exception 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: out, err, code = await self._run_cephadm( 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: raise OrchestratorError( 2024-09-17T01:04:35.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Creating ceph-iscsi config... 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return _run_code(code, main_globals, None, 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: exec(code, run_globals) 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:35.464 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:35.465 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:35.465 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:35.465 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:35.465 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:35.465 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:35.465 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:35.465 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.177 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:36 smithi135 ceph-mon[24697]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:36.177 INFO:journalctl@ceph.mon.b.smithi135.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:36.177 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: exec(code, run_globals) 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:36.178 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.wait_async( 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:36.179 INFO:journalctl@ceph.mon.b.smithi135.stdout: return future.result(timeout) 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.__get_result() 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: raise self._exception 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: raise OrchestratorError( 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:36.180 INFO:journalctl@ceph.mon.b.smithi135.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: exec(code, run_globals) 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:36.181 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.182 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[23769]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:36.396 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:36.397 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.wait_async( 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: return future.result(timeout) 2024-09-17T01:04:36.398 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[28615]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:36.399 INFO:journalctl@ceph.mon.c.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.400 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.wait_async( 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: return future.result(timeout) 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.__get_result() 2024-09-17T01:04:36.401 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: raise self._exception 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: raise OrchestratorError( 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.402 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.__get_result() 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: raise self._exception 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: raise OrchestratorError( 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:36.404 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:36.405 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.c.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.c.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:04:36.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:36.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:04:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:04:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T01:04:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T01:04:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T01:04:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T01:04:37.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-17T01:04:37.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-17T01:04:37.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:04:37.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: Reconfiguring prometheus.a (dependencies changed)... 2024-09-17T01:04:37.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: Reconfiguring daemon prometheus.a on smithi135 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:37.441 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[28615]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-17T01:04:38.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[28615]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:38.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[23769]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-17T01:04:38.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[23769]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:38.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:38 smithi135 ceph-mon[24697]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-17T01:04:38.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:38 smithi135 ceph-mon[24697]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:38.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:38.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:39.172 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:39 smithi135 ceph-mon[24697]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:39.172 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:39 smithi135 ceph-mon[24697]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:39.341 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:39 smithi071 ceph-mon[23769]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:39.341 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:39 smithi071 ceph-mon[23769]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:39.341 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:39 smithi071 ceph-mon[28615]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:39.341 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:39 smithi071 ceph-mon[28615]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:39.641 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:39 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[65647]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:04:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-17T01:04:39.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:39 smithi135 systemd[1]: Stopping Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:40.335 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T01:04:40.335 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.054Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.055Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.055Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.055Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[58330]: ts=2024-09-17T01:04:40.055Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-17T01:04:40.336 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 podman[61400]: 2024-09-17 01:04:40.064812128 +0000 UTC m=+0.126093241 container died cd1d499f251acddaaf37b5a1cf5945590abbf51aa2c21fa50044a516a5a201a2 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:40.694 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 podman[61400]: 2024-09-17 01:04:40.446282312 +0000 UTC m=+0.507563423 container cleanup cd1d499f251acddaaf37b5a1cf5945590abbf51aa2c21fa50044a516a5a201a2 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:40.695 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 bash[61400]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T01:04:40.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:40.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:40.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-mon[24697]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:40.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-mon[24697]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:40.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:40.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 podman[61411]: 2024-09-17 01:04:40.697789687 +0000 UTC m=+0.634678384 container remove cd1d499f251acddaaf37b5a1cf5945590abbf51aa2c21fa50044a516a5a201a2 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:40.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-17T01:04:40.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 systemd[1]: Stopped Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:40.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service: Consumed 1.044s CPU time. 2024-09-17T01:04:40.962 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:40 smithi135 systemd[1]: Starting Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[23769]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[23769]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:41.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[28615]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[28615]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:41.342 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 podman[61500]: 2024-09-17 01:04:40.982397198 +0000 UTC m=+0.017002933 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-17T01:04:41.342 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 podman[61500]: 2024-09-17 01:04:41.090967774 +0000 UTC m=+0.125573499 container create 9b787f60f5f1bfa76f432ca497d8ea4c508dd5beaf1f6c721f4d72c3f8eaaf1d (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:41.343 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 podman[61500]: 2024-09-17 01:04:41.318760026 +0000 UTC m=+0.353365751 container init 9b787f60f5f1bfa76f432ca497d8ea4c508dd5beaf1f6c721f4d72c3f8eaaf1d (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:41.343 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 podman[61500]: 2024-09-17 01:04:41.321513979 +0000 UTC m=+0.356119705 container start 9b787f60f5f1bfa76f432ca497d8ea4c508dd5beaf1f6c721f4d72c3f8eaaf1d (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:04:41.615 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.345Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-17T01:04:41.615 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.345Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-17T01:04:41.615 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.345Z caller=main.go:570 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi135 (none))" 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.345Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.345Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.347Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.347Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.348Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.348Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.350Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.350Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.654µs 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.350Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.350Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.368Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-09-17T01:04:41.616 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.374Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.377Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.377Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.377Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.728µs wal_replay_duration=26.900026ms wbl_replay_duration=140ns total_replay_duration=26.938777ms 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.381Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.381Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.381Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.401Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.998715ms db_storage=900ns remote_storage=1.181µs web_handler=434ns query_engine=760ns scrape=452.539µs scrape_sd=88.815µs notify=18.472µs notify_sd=22.128µs rules=19.057224ms tracing=6.771µs 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.401Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:41.401Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 bash[61500]: 9b787f60f5f1bfa76f432ca497d8ea4c508dd5beaf1f6c721f4d72c3f8eaaf1d 2024-09-17T01:04:41.617 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:41 smithi135 systemd[1]: Started Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:42 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:42 smithi135 ceph-mon[24697]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:42.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:42.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[28615]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:42.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:42 smithi071 ceph-mon[23769]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:43.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: Upgrade: Updating mgr.y 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[23769]: Deploying daemon mgr.y on smithi071 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: Upgrade: Updating mgr.y 2024-09-17T01:04:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:04:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:43 smithi071 ceph-mon[28615]: Deploying daemon mgr.y on smithi071 2024-09-17T01:04:43.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: Upgrade: Updating mgr.y 2024-09-17T01:04:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:04:43.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:04:43.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:43.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:43 smithi135 ceph-mon[24697]: Deploying daemon mgr.y on smithi071 2024-09-17T01:04:44.783 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:44 smithi071 systemd[1]: Stopping Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:44.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:44 smithi135 ceph-mon[24697]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:45.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:44 smithi071 ceph-mon[23769]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:45.044 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:44 smithi071 ceph-mon[28615]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:45.045 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:44 smithi071 podman[72190]: 2024-09-17 01:04:44.785829063 +0000 UTC m=+0.127978218 container died c23b8f0354b9ca169e2bc278e2b5409a094f92bdac8492c0b819e7df36377f9b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:04:45.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:45 smithi071 podman[72190]: 2024-09-17 01:04:45.138397028 +0000 UTC m=+0.480546177 container cleanup c23b8f0354b9ca169e2bc278e2b5409a094f92bdac8492c0b819e7df36377f9b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-17T01:04:45.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:45 smithi071 bash[72190]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y 2024-09-17T01:04:45.740 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:45 smithi071 podman[72202]: 2024-09-17 01:04:45.422890364 +0000 UTC m=+0.632184419 container remove c23b8f0354b9ca169e2bc278e2b5409a094f92bdac8492c0b819e7df36377f9b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-17T01:04:45.740 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:45 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:04:45.999 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:45 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-17T01:04:45.999 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:45 smithi071 systemd[1]: Stopped Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:45.999 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:45 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Consumed 21.032s CPU time. 2024-09-17T01:04:46.303 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:46 smithi071 systemd[1]: Starting Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:04:46.818 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:46 smithi071 podman[72499]: 2024-09-17 01:04:46.587555009 +0000 UTC m=+0.017045101 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:04:46.818 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:46 smithi071 podman[72499]: 2024-09-17 01:04:46.698217447 +0000 UTC m=+0.127707537 container create d6811d87aa8543d643da20f56facbe765bc3f0229c29123ebfae9ba4a4274d63 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T01:04:47.095 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:46 smithi071 podman[72499]: 2024-09-17 01:04:46.942506779 +0000 UTC m=+0.371996875 container init d6811d87aa8543d643da20f56facbe765bc3f0229c29123ebfae9ba4a4274d63 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T01:04:47.096 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:46 smithi071 podman[72499]: 2024-09-17 01:04:46.945309718 +0000 UTC m=+0.374799816 container start d6811d87aa8543d643da20f56facbe765bc3f0229c29123ebfae9ba4a4274d63 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-17T01:04:47.096 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:46 smithi071 ceph-mgr[72564]: -- 172.21.15.71:0/1083237447 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5620bb2450e0 con 0x5620bb223400 2024-09-17T01:04:47.096 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 bash[72499]: d6811d87aa8543d643da20f56facbe765bc3f0229c29123ebfae9ba4a4274d63 2024-09-17T01:04:47.096 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 systemd[1]: Started Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:04:47.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:04:46] "GET /metrics HTTP/1.1" 200 38243 "" "Prometheus/2.43.0" 2024-09-17T01:04:47.390 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:47.097+0000 7fb147861040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:04:47.391 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:47.158+0000 7fb147861040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:47.391 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:47.319+0000 7fb147861040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:04:47.391 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.391 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.391 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.391 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.391 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1219707389' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/396675637' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/93017477"}]: dispatch 2024-09-17T01:04:47.392 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1219707389' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:47.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:47.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/396675637' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/93017477"}]: dispatch 2024-09-17T01:04:47.625 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:04:47.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:47.392+0000 7fb147861040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:04:47.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:47.564+0000 7fb147861040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1219707389' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:47.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:47 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/396675637' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/93017477"}]: dispatch 2024-09-17T01:04:48.051 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:47 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:47.717+0000 7fb147861040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:04:48.051 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:48.053+0000 7fb147861040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:04:48.325 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:48.128+0000 7fb147861040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:04:48.332 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:04:48.332 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 8s ago 12m - - 2024-09-17T01:04:48.332 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 2s ago 11m - - 2024-09-17T01:04:48.332 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (98s) 8s ago 7m 15.4M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:04:48.332 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (65s) 2s ago 6m 42.3M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:04:48.332 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 unknown 8s ago 5m 48.7M - 3.5 e1d6a67b021e e2166ab3f1e8 2024-09-17T01:04:48.332 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (26s) 2s ago 11m 493M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 starting - - - - 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (13m) 8s ago 13m 63.3M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (11m) 2s ago 11m 54.2M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (11m) 8s ago 11m 58.4M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (109s) 8s ago 7m 8242k - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (72s) 2s ago 7m 16.4M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (11m) 8s ago 11m 56.5M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (10m) 8s ago 10m 55.4M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (10m) 8s ago 10m 50.1M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (9m) 8s ago 9m 55.5M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (9m) 2s ago 9m 55.9M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (9m) 2s ago 9m 51.6M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (8m) 2s ago 8m 49.9M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (8m) 2s ago 8m 56.7M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:04:48.333 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (31s) 2s ago 7m 50.5M - 2.43.0 a07b618ecd1d cd1d499f251a 2024-09-17T01:04:48.334 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (5m) 8s ago 5m 75.1M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:04:48.334 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (5m) 2s ago 5m 73.4M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:04:48.334 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (5m) 8s ago 5m 73.2M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:04:48.334 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (5m) 2s ago 5m 73.4M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:04:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[28615]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[28615]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[28615]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[28615]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:48.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/396675637' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/93017477"}]': finished 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[28615]: osdmap e107: 8 total, 8 up, 8 in 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[23769]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[23769]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[23769]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[23769]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/396675637' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/93017477"}]': finished 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-mon[23769]: osdmap e107: 8 total, 8 up, 8 in 2024-09-17T01:04:48.647 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:48.327+0000 7fb147861040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:04:48.655 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-mon[24697]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:48.655 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-mon[24697]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:04:48.656 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:48.656 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-mon[24697]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:48.656 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-mon[24697]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:48.656 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/396675637' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6801/93017477"}]': finished 2024-09-17T01:04:48.656 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-mon[24697]: osdmap e107: 8 total, 8 up, 8 in 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:48.757 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:04:48.758 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:04:48.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:48.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:49.117 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:04:49.118 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:04:49.379 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:49.308+0000 7fb147861040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:04:49.379 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[28615]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[28615]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[28615]: from='client.25456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1436649756' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1811275222"}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3776730254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[23769]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[23769]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[23769]: from='client.25456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1436649756' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1811275222"}]: dispatch 2024-09-17T01:04:49.380 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3776730254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:49.534 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-09-17T01:04:49.535 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-09-17T01:04:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: daemon iscsi.foo.smithi071.mtaene on smithi071 is in unknown state 2024-09-17T01:04:49.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:49.381+0000 7fb147861040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:04:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-mon[24697]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-mon[24697]: from='client.15540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-mon[24697]: from='client.25456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1436649756' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1811275222"}]: dispatch 2024-09-17T01:04:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3776730254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:50.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:04:49.985+0000 7fce2e2c2640 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Creating ceph-iscsi config... 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return _run_code(code, main_globals, None, 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:50.337 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: exec(code, run_globals) 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:50.338 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.wait_async( 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return future.result(timeout) 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.__get_result() 2024-09-17T01:04:50.339 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: raise self._exception 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: out, err, code = await self._run_cephadm( 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: raise OrchestratorError( 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Creating ceph-iscsi config... 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:50.340 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return _run_code(code, main_globals, None, 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: exec(code, run_globals) 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:50.341 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:49 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:50.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.138+0000 7fb147861040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:04:50.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.259+0000 7fb147861040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='client.25474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1436649756' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1811275222"}]': finished 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: osdmap e108: 8 total, 8 up, 8 in 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/255052417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:50.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-09-17T01:04:50.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='client.25474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:50.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1436649756' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1811275222"}]': finished 2024-09-17T01:04:50.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: osdmap e108: 8 total, 8 up, 8 in 2024-09-17T01:04:50.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/255052417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:50.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:50.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:50.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:50.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:50.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:50.698 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.448+0000 7fb147861040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:04:50.698 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.517+0000 7fb147861040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:04:50.698 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.673+0000 7fb147861040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='client.25474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1436649756' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1811275222"}]': finished 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: osdmap e108: 8 total, 8 up, 8 in 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/255052417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:04:50.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:50 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:50.969 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.745+0000 7fb147861040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:04:50.969 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.806+0000 7fb147861040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:04:51.248 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:50.971+0000 7fb147861040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:04:51.249 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:51.038+0000 7fb147861040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:04:51.249 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:51.106+0000 7fb147861040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:04:51.249 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:51.189+0000 7fb147861040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:04:51.593 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[23769]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:51.593 INFO:journalctl@ceph.mon.a.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:51.593 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:51.593 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:51.593 INFO:journalctl@ceph.mon.a.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:51.593 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.594 INFO:journalctl@ceph.mon.a.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.wait_async( 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: return future.result(timeout) 2024-09-17T01:04:51.595 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:51.250+0000 7fb147861040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:51.311+0000 7fb147861040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[28615]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mon.c.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mon.c.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.596 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.597 INFO:journalctl@ceph.mon.c.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.wait_async( 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: return future.result(timeout) 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:51.598 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.__get_result() 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: raise self._exception 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: raise OrchestratorError( 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.599 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:51.600 INFO:journalctl@ceph.mon.a.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.a.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[23769]: Upgrade: Setting container_image for all mgr 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[23769]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 551 B/s rd, 0 op/s 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.__get_result() 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: raise self._exception 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: raise OrchestratorError( 2024-09-17T01:04:51.601 INFO:journalctl@ceph.mon.c.smithi071.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:51.602 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[28615]: Upgrade: Setting container_image for all mgr 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[28615]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 551 B/s rd, 0 op/s 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[23769]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1 op/s 2024-09-17T01:04:51.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:51.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[23769]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:51.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[23769]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:51.604 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[28615]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1 op/s 2024-09-17T01:04:51.604 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:51.604 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[28615]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:51.604 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:51 smithi071 ceph-mon[28615]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:51 smithi135 ceph-mon[24697]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: exec(code, run_globals) 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:51.711 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1134, in _check_daemons 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2473, in _daemon_action 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.wait_async( 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 796, in wait_async 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.event_loop.get_result(coro, timeout) 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: return future.result(timeout) 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 446, in result 2024-09-17T01:04:51.712 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.__get_result() 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: raise self._exception 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1370, in _create_daemon 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: out, err, code = await self._run_cephadm( 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1713, in _run_cephadm 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: raise OrchestratorError( 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: Creating ceph-iscsi config... 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: Non-zero exit code 1 from systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.713 INFO:journalctl@ceph.mon.b.smithi135.stdout: systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: exec(code, run_globals) 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1124, in deploy_daemon 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:04:51.714 INFO:journalctl@ceph.mon.b.smithi135.stdout: RuntimeError: Failed command: systemctl restart ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi135.stdout: See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:51 smithi135 ceph-mon[24697]: Upgrade: Setting container_image for all mgr 2024-09-17T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:51 smithi135 ceph-mon[24697]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 551 B/s rd, 0 op/s 2024-09-17T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:51 smithi135 ceph-mon[24697]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1 op/s 2024-09-17T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:51 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:51 smithi135 ceph-mon[24697]: Reconfiguring iscsi.foo.smithi071.mtaene (dependencies changed)... 2024-09-17T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:51 smithi135 ceph-mon[24697]: Reconfiguring daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:04:52.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[23769]: Standby manager daemon y restarted 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:52.173+0000 7fb147861040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: [17/Sep/2024:01:04:52] ENGINE Bus STARTING 2024-09-17T01:04:52.397 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: CherryPy Checker: 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: The Application mounted at '' has an empty config. 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: [17/Sep/2024:01:04:52] ENGINE Serving on http://:::9283 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[72557]: [17/Sep/2024:01:04:52] ENGINE Bus STARTED 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[28615]: Standby manager daemon y restarted 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:04:52.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:52 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:52 smithi135 ceph-mon[24697]: Standby manager daemon y restarted 2024-09-17T01:04:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:52 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:04:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:52 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:04:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:52 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:04:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:52 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:04:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:52 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2955224448' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:04:53.456 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:53 smithi071 ceph-mon[28615]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 413 B/s rd, 0 op/s 2024-09-17T01:04:53.457 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:53 smithi071 ceph-mon[28615]: mgrmap e37: x(active, since 24s), standbys: y 2024-09-17T01:04:53.457 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:53 smithi071 ceph-mon[23769]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 413 B/s rd, 0 op/s 2024-09-17T01:04:53.457 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:53 smithi071 ceph-mon[23769]: mgrmap e37: x(active, since 24s), standbys: y 2024-09-17T01:04:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:53 smithi135 ceph-mon[24697]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 413 B/s rd, 0 op/s 2024-09-17T01:04:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:53 smithi135 ceph-mon[24697]: mgrmap e37: x(active, since 24s), standbys: y 2024-09-17T01:04:53.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:53.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1 op/s 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2675947913' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1659496876' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:55.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:55.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1 op/s 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 692 B/s rd, 1 op/s 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.241 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2675947913' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1659496876' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2675947913' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1659496876' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:55.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.208 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.208 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.208 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.208 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Cluster is now healthy 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.209 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Cluster is now healthy 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.212 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.213 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]': finished 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: osdmap e109: 8 total, 8 up, 8 in 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.215 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]': finished 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: osdmap e109: 8 total, 8 up, 8 in 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.216 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Cluster is now healthy 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:56.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:6800/93017477"}]': finished 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: osdmap e109: 8 total, 8 up, 8 in 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:56.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:56.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:56.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:56.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:56.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:04:56] "GET /metrics HTTP/1.1" 200 38243 "" "Prometheus/2.43.0" 2024-09-17T01:04:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 307 B/s rd, 0 op/s 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2032456575' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/867545245"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.384 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 307 B/s rd, 0 op/s 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2032456575' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/867545245"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.385 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.386 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 307 B/s rd, 0 op/s 2024-09-17T01:04:57.387 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2032456575' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/867545245"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.389 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.390 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.391 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.392 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.393 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:57.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:57.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:57.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:57.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:57.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:57.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/2032456575' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/867545245"}]': finished 2024-09-17T01:04:57.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: osdmap e110: 8 total, 8 up, 8 in 2024-09-17T01:04:58.270 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/2032456575' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/867545245"}]': finished 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: osdmap e110: 8 total, 8 up, 8 in 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/466848376' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.273 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.273 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.273 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.273 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.273 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.273 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.273 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/466848376' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.274 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.275 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.276 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.277 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.278 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.279 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.279 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.279 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.279 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.279 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2032456575' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/867545245"}]': finished 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: osdmap e110: 8 total, 8 up, 8 in 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.293 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/466848376' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.295 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.296 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.297 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.297 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:58.297 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:58.297 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:58.297 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:58.297 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:58.945 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:04:58.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:04:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 257 B/s rd, 0 op/s 2024-09-17T01:04:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]': finished 2024-09-17T01:04:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: osdmap e111: 8 total, 8 up, 8 in 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3638590782' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 257 B/s rd, 0 op/s 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]': finished 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: osdmap e111: 8 total, 8 up, 8 in 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 257 B/s rd, 0 op/s 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/866341436"}]': finished 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: osdmap e111: 8 total, 8 up, 8 in 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/3638590782' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.315 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3638590782' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.318 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.186 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.187 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.188 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.188 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.188 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.188 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.188 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.188 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.188 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.189 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.190 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]': finished 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: osdmap e112: 8 total, 8 up, 8 in 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.192 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]': finished 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: osdmap e112: 8 total, 8 up, 8 in 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:04:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='client.? ' entity='client.iscsi.foo.smithi071.mtaene' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.71:0/1375019797"}]': finished 2024-09-17T01:05:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: osdmap e112: 8 total, 8 up, 8 in 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:04:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:01.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:01.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:00 smithi135 ceph-mon[24697]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:05:01.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:01.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[28615]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:05:01.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-17T01:05:01.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:01.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:00 smithi071 ceph-mon[23769]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:05:03.004 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[28615]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:05:03.004 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[23769]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:03.005 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:03.435 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:03 smithi135 ceph-mon[24697]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:05:03.435 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:03.435 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:03.435 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:03.435 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:03.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:03.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:04 smithi135 ceph-mon[24697]: Upgrade: Updating mgr.y 2024-09-17T01:05:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:04 smithi135 ceph-mon[24697]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.266 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[23769]: Upgrade: Updating mgr.y 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[23769]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[28615]: Upgrade: Updating mgr.y 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[28615]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:04.267 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.162 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:05 smithi135 ceph-mon[24697]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-17T01:05:05.162 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:05 smithi135 ceph-mon[24697]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:05.162 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:05 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:05.162 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:05 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.162 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:05 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.163 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:05 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.236 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[23769]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-17T01:05:05.236 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[23769]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:05.236 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[23769]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[28615]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[28615]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:05.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:05 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.593 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[23769]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:05:06.593 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.593 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.593 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.593 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[23769]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:05:06.593 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[23769]: Cluster is now healthy 2024-09-17T01:05:06.594 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[28615]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:05:06.594 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.594 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.594 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.594 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[28615]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:05:06.594 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:06 smithi071 ceph-mon[28615]: Cluster is now healthy 2024-09-17T01:05:06.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:06 smithi135 ceph-mon[24697]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:05:06.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:06 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:06 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:06 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:06.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:06 smithi135 ceph-mon[24697]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:05:06.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:06 smithi135 ceph-mon[24697]: Cluster is now healthy 2024-09-17T01:05:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:05:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:05:06] "GET /metrics HTTP/1.1" 200 38245 "" "Prometheus/2.43.0" 2024-09-17T01:05:08.699 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:08 smithi071 ceph-mon[23769]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 753 B/s rd, 0 op/s 2024-09-17T01:05:08.700 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:08 smithi071 ceph-mon[28615]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 753 B/s rd, 0 op/s 2024-09-17T01:05:08.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:08 smithi135 ceph-mon[24697]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 753 B/s rd, 0 op/s 2024-09-17T01:05:08.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:08.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:09.101 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:08 smithi071 systemd[1]: Stopping Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:09.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 podman[76640]: 2024-09-17 01:05:09.103012755 +0000 UTC m=+0.148245999 container died d6811d87aa8543d643da20f56facbe765bc3f0229c29123ebfae9ba4a4274d63 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T01:05:09.803 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 podman[76640]: 2024-09-17 01:05:09.605245459 +0000 UTC m=+0.650478702 container cleanup d6811d87aa8543d643da20f56facbe765bc3f0229c29123ebfae9ba4a4274d63 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T01:05:09.803 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 bash[76640]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y 2024-09-17T01:05:10.056 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 podman[76652]: 2024-09-17 01:05:09.806260207 +0000 UTC m=+0.700468856 container remove d6811d87aa8543d643da20f56facbe765bc3f0229c29123ebfae9ba4a4274d63 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-17T01:05:10.057 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:05:10.057 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-17T01:05:10.057 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 systemd[1]: Stopped Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:10.057 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:09 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Consumed 6.142s CPU time. 2024-09-17T01:05:10.368 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 systemd[1]: Starting Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:10.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:10 smithi071 ceph-mon[23769]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:05:10.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:10 smithi071 ceph-mon[28615]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:05:10.625 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 podman[76780]: 2024-09-17 01:05:10.27413575 +0000 UTC m=+0.016318322 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-09-17T01:05:10.625 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 podman[76780]: 2024-09-17 01:05:10.382774289 +0000 UTC m=+0.124956856 container create 376a5b951ec939c270162e7ae0c99b874c03c5b0ed5f26e16825ad4fbd28e970 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, ceph=True, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, vcs-type=git, GIT_BRANCH=HEAD, io.openshift.expose-services=, vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, architecture=x86_64, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8) 2024-09-17T01:05:10.626 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 podman[76780]: 2024-09-17 01:05:10.602408419 +0000 UTC m=+0.344590993 container init 376a5b951ec939c270162e7ae0c99b874c03c5b0ed5f26e16825ad4fbd28e970 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, release=754, io.openshift.expose-services=, RELEASE=HEAD, distribution-scope=public, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, com.redhat.component=centos-stream-container, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, name=centos-stream, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-09-17T01:05:10.626 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 podman[76780]: 2024-09-17 01:05:10.606485108 +0000 UTC m=+0.348667674 container start 376a5b951ec939c270162e7ae0c99b874c03c5b0ed5f26e16825ad4fbd28e970 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, vendor=Red Hat, Inc., ceph=True, distribution-scope=public, architecture=x86_64, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8) 2024-09-17T01:05:10.626 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 ceph-mgr[76798]: -- 172.21.15.71:0/872183065 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563fdd502340 con 0x563fdd4da800 2024-09-17T01:05:10.709 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:10 smithi135 ceph-mon[24697]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:05:10.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 bash[76780]: 376a5b951ec939c270162e7ae0c99b874c03c5b0ed5f26e16825ad4fbd28e970 2024-09-17T01:05:10.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 systemd[1]: Started Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:10.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:10.750+0000 7fd143751000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:05:10.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:10.842+0000 7fd143751000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:05:11.153 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:11.022+0000 7fd143751000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:05:11.153 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:11.114+0000 7fd143751000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:05:11.482 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:11.255+0000 7fd143751000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:05:11.482 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:11.484+0000 7fd143751000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:05:12.117 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:11.849+0000 7fd143751000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:05:12.117 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:11.946+0000 7fd143751000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:05:12.118 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:12.119+0000 7fd143751000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:05:12.118 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:05:12.118 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.118 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.118 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.118 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.118 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.119 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.120 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.121 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.122 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.123 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.124 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.125 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:11 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:05:12.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:11 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.811 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.811 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.811 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.811 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.811 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.812 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.813 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.815 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.816 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:12.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:12 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.115 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.116 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.117 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.118 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.119 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:12 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:13.262+0000 7fd143751000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:05:13.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:13.358+0000 7fd143751000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:05:13.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:13.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 564 B/s rd, 0 op/s 2024-09-17T01:05:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:13.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 564 B/s rd, 0 op/s 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 564 B/s rd, 0 op/s 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.047 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.049 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.050 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.050 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.050 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:14.348+0000 7fd143751000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:05:14.938 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:14.681+0000 7fd143751000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:05:14.938 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:14.828+0000 7fd143751000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:05:14.939 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.939 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.939 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.940 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.940 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.940 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.940 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.940 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.940 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.941 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.941 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.941 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.941 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.941 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.942 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.942 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.942 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.942 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.942 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.942 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.943 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.944 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:14.944 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.944 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.944 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.946 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.946 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.946 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.946 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.946 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.947 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.948 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.948 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.948 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.948 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.948 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.949 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.949 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.949 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:14.949 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.949 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.949 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.950 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.950 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.950 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.950 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.951 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.951 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.951 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.951 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.951 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.953 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.954 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.954 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.954 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.954 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.955 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.955 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.955 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.955 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.955 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.955 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.956 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.956 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:14.956 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.956 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.956 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.956 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.957 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.957 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.957 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.957 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.957 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.957 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:14.958 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.958 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.958 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:14.958 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:14.958 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:15.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:15.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:15.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:14 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:15.301 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:14.940+0000 7fd143751000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:05:15.301 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:15.045+0000 7fd143751000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:05:15.301 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:15.144+0000 7fd143751000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:05:15.301 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:15.303+0000 7fd143751000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:05:15.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:15.402+0000 7fd143751000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:05:15.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:15.505+0000 7fd143751000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:05:16.004 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:15.805+0000 7fd143751000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:05:16.004 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:15.910+0000 7fd143751000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:05:16.005 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.005 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.006 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.006 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 0 op/s 2024-09-17T01:05:16.006 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.006 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.006 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.006 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.007 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.008 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.008 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.008 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.008 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.008 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.008 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.009 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.010 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.010 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.010 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.010 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.010 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.011 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.012 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.013 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.013 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.013 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.013 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.013 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.013 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.014 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.014 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.014 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.014 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.014 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.014 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.015 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.015 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 0 op/s 2024-09-17T01:05:16.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.016 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.017 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.017 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.017 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.017 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.017 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.017 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.018 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.019 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.020 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.021 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.022 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:15 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 924 B/s rd, 0 op/s 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:15 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:16.006+0000 7fd143751000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:16 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:05:16] "GET /metrics HTTP/1.1" 200 38245 "" "Prometheus/2.43.0" 2024-09-17T01:05:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:17.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:17.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:17.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:17.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:17.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:16 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:17.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:17.205+0000 7fd143751000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:05:17.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: [17/Sep/2024:01:05:17] ENGINE Bus STARTING 2024-09-17T01:05:17.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: CherryPy Checker: 2024-09-17T01:05:17.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: The Application mounted at '' has an empty config. 2024-09-17T01:05:17.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: 2024-09-17T01:05:17.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: [17/Sep/2024:01:05:17] ENGINE Serving on http://:::9283 2024-09-17T01:05:17.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[76794]: [17/Sep/2024:01:05:17] ENGINE Bus STARTED 2024-09-17T01:05:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:18.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Standby manager daemon y restarted 2024-09-17T01:05:18.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:05:18.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:18.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:18.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Standby manager daemon y restarted 2024-09-17T01:05:18.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:05:18.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:18.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:18.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:18.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:18.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.158 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:18.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:18.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:18.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.161 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.161 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.161 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.161 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.161 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.161 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.163 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.163 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:17 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:18.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Standby manager daemon y restarted 2024-09-17T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/2' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.218 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.219 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:17 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: mgrmap e38: x(active, since 50s), standbys: y 2024-09-17T01:05:18.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:18.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:18.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: mgrmap e38: x(active, since 50s), standbys: y 2024-09-17T01:05:18.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:18.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:18 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:18.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: mgrmap e38: x(active, since 50s), standbys: y 2024-09-17T01:05:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:18.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:18.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:18.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:18.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:18.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:18 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:19.918 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:05:20.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:19 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:20.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:20.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:20.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:20.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:19 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:20.614 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:05:20.614 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 15s ago 12m - - 2024-09-17T01:05:20.614 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 17s ago 12m - - 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (2m) 15s ago 7m 20.0M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (97s) 17s ago 7m 42.5M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (27s) 15s ago 5m 50.3M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (58s) 17s ago 11m 503M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 starting - - - - 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (13m) 15s ago 13m 58.2M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (12m) 17s ago 12m 60.5M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (12m) 15s ago 12m 52.1M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (2m) 15s ago 8m 15.9M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (104s) 17s ago 7m 17.0M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (11m) 15s ago 11m 57.0M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (11m) 15s ago 11m 55.9M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:05:20.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (10m) 15s ago 10m 50.7M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (10m) 15s ago 10m 56.0M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (10m) 17s ago 9m 56.1M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (9m) 17s ago 9m 51.0M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (9m) 17s ago 9m 50.2M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (8m) 17s ago 8m 56.1M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (39s) 17s ago 8m 53.3M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (6m) 15s ago 6m 75.2M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (6m) 17s ago 6m 73.6M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (5m) 15s ago 5m 73.3M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:05:20.616 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (5m) 17s ago 5m 73.5M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:05:21.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='client.25546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.038 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='client.25546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:20 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:05:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 16, 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:05:21.053 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:05:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='client.25546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:20 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.410 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:05:21.411 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:05:21.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/585417415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/585417415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.883 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.884 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.885 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.885 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:21 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.885 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:05:21.906 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.906 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.906 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='client.25552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/585417415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:21.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:21 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.031 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.032 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/1781947901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.033 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.034 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/1781947901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.035 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.036 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:22 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.076 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.077 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1781947901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.078 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.079 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.080 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:22 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.775 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:23.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:23.961 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.961 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.964 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.965 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.966 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.967 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.968 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.969 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:23.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:23 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.049 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.050 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.051 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.052 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:23 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[23769]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:24.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:24.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:24.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:24 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:25.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:25.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:24 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:26.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:25 smithi071 ceph-mon[28615]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:26.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:25 smithi071 ceph-mon[23769]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:26.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:25 smithi135 ceph-mon[24697]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:27.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:05:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:05:26] "GET /metrics HTTP/1.1" 200 38245 "" "Prometheus/2.43.0" 2024-09-17T01:05:27.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: Upgrade: Updating mgr.y 2024-09-17T01:05:27.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:27.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:27.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[28615]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: Upgrade: Updating mgr.y 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:27.810 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:27.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:27 smithi071 ceph-mon[23769]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: Upgrade: Updating mgr.y 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:27 smithi135 ceph-mon[24697]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:28.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:28 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:28.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:28 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:28.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:28 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:28.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:28.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:29.830 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:29 smithi071 systemd[1]: Stopping Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:30.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:29 smithi071 ceph-mon[23769]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:30.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:29 smithi071 ceph-mon[28615]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:30.105 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:29 smithi071 podman[82238]: 2024-09-17 01:05:29.837205293 +0000 UTC m=+0.130428271 container died 376a5b951ec939c270162e7ae0c99b874c03c5b0ed5f26e16825ad4fbd28e970 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, vendor=Red Hat, Inc., ceph=True, io.openshift.expose-services=, GIT_CLEAN=True, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, release=754, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, architecture=x86_64) 2024-09-17T01:05:30.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:29 smithi135 ceph-mon[24697]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:30.361 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:30 smithi071 podman[82238]: 2024-09-17 01:05:30.34827729 +0000 UTC m=+0.641500257 container cleanup 376a5b951ec939c270162e7ae0c99b874c03c5b0ed5f26e16825ad4fbd28e970 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, com.redhat.component=centos-stream-container, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, release=754, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., ceph=True, io.openshift.expose-services=, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, GIT_CLEAN=True, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, distribution-scope=public) 2024-09-17T01:05:30.361 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:30 smithi071 bash[82238]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y 2024-09-17T01:05:30.845 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:30 smithi071 podman[82252]: 2024-09-17 01:05:30.583194731 +0000 UTC m=+0.746406402 container remove 376a5b951ec939c270162e7ae0c99b874c03c5b0ed5f26e16825ad4fbd28e970 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, version=8, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, name=centos-stream, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., architecture=x86_64, release=754, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.buildah.version=1.19.8, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-09-17T01:05:30.845 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:30 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:05:30.845 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:30 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-17T01:05:30.846 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:30 smithi071 systemd[1]: Stopped Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:30.846 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:30 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Consumed 8.001s CPU time. 2024-09-17T01:05:31.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 systemd[1]: Starting Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:31.517 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 podman[82377]: 2024-09-17 01:05:31.158666167 +0000 UTC m=+0.015947152 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:31.517 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 podman[82377]: 2024-09-17 01:05:31.267977636 +0000 UTC m=+0.125258611 container create 41a7626c1dbf8ca82f5e67287de49abbd71535c5b666dcfb5cc316dafc7c44de (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:05:31.834 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 podman[82377]: 2024-09-17 01:05:31.520493994 +0000 UTC m=+0.377774969 container init 41a7626c1dbf8ca82f5e67287de49abbd71535c5b666dcfb5cc316dafc7c44de (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T01:05:31.834 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 podman[82377]: 2024-09-17 01:05:31.524100121 +0000 UTC m=+0.381381106 container start 41a7626c1dbf8ca82f5e67287de49abbd71535c5b666dcfb5cc316dafc7c44de (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T01:05:31.834 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mgr[82396]: -- 172.21.15.71:0/4258687984 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f0052830e0 con 0x55f005261400 2024-09-17T01:05:31.834 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 bash[82377]: 41a7626c1dbf8ca82f5e67287de49abbd71535c5b666dcfb5cc316dafc7c44de 2024-09-17T01:05:31.834 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 systemd[1]: Started Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:31.835 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:31.650+0000 7f2291944040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:05:31.835 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:31.716+0000 7f2291944040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:05:32.099 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:31.878+0000 7f2291944040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:05:32.099 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:31.945+0000 7f2291944040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:05:32.099 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:32.101+0000 7f2291944040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:32.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:05:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:32.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:31 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:32.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:05:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:31 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.371 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:32.247+0000 7f2291944040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:05:32.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:32.593+0000 7f2291944040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:05:32.972 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:32.660+0000 7f2291944040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:05:32.972 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:32.860+0000 7f2291944040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.973 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.974 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.975 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.976 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.977 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.978 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.979 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:32.980 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.981 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:32.982 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:32.982 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:32.982 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:32.982 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:32.982 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:32 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:33.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:33.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:33.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:33.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:32 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:33.843 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:33.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:34.038 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:33.873+0000 7f2291944040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:05:34.038 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:33.946+0000 7f2291944040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:05:34.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.040 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:34.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.046 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.047 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.048 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:33 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:34.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:34.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:33 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.050 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.051 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.052 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.054 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:34.765+0000 7f2291944040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:34.896+0000 7f2291944040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.052+0000 7f2291944040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.056 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.058 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.059 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.060 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.061 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:34 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:35.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:35.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:34 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:35.324 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.120+0000 7f2291944040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:05:35.593 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.288+0000 7f2291944040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:05:35.593 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.360+0000 7f2291944040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:05:35.593 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.425+0000 7f2291944040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:05:35.593 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.594+0000 7f2291944040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:05:35.848 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.666+0000 7f2291944040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:05:35.848 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.736+0000 7f2291944040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:05:35.848 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.821+0000 7f2291944040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:05:36.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.885+0000 7f2291944040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:05:36.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:35.946+0000 7f2291944040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:05:36.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.158 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.159 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.161 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.162 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:35 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:36.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:35 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:36.791+0000 7f2291944040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:05:37.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: [17/Sep/2024:01:05:36] ENGINE Bus STARTING 2024-09-17T01:05:37.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: CherryPy Checker: 2024-09-17T01:05:37.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: The Application mounted at '' has an empty config. 2024-09-17T01:05:37.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: 2024-09-17T01:05:37.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: [17/Sep/2024:01:05:36] ENGINE Serving on http://:::9283 2024-09-17T01:05:37.147 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[82392]: [17/Sep/2024:01:05:36] ENGINE Bus STARTED 2024-09-17T01:05:37.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Standby manager daemon y restarted 2024-09-17T01:05:37.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Standby manager daemon y restarted 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:37.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:36 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:37.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:05:36] "GET /metrics HTTP/1.1" 200 38245 "" "Prometheus/2.43.0" 2024-09-17T01:05:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Standby manager daemon y restarted 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:05:37.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:37.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:37.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:37.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:36 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/225510193' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:38.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.043 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: mgrmap e39: x(active, since 70s), standbys: y 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.045 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: mgrmap e39: x(active, since 70s), standbys: y 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.046 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:37 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: mgrmap e39: x(active, since 70s), standbys: y 2024-09-17T01:05:38.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:37 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:38.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:38.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:38.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:38 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.1.1-330-gc2ddf972 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:38 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.856 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.857 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:39.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:39.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:39.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:39 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:40.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.151 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.152 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.153 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.154 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:40.155 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:39 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:40 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:41.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:40 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:42.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.083 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.084 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:41 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:41 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:42.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:42.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:42.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:42.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:42.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:42.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:42 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.108 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.110 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:43.112 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:42 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:43.522 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:44.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:44.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.100 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.101 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.105 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:43 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:43 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.987 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:44.988 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.989 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:44.990 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:44 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:45.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:44 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:46.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:46 smithi071 ceph-mon[28615]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:46.265 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:46 smithi071 ceph-mon[23769]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:46.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:46 smithi135 ceph-mon[24697]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:47.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:05:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:05:46] "GET /metrics HTTP/1.1" 200 38244 "" "Prometheus/2.43.0" 2024-09-17T01:05:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:48 smithi071 ceph-mon[23769]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:48.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:48 smithi071 ceph-mon[28615]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:48.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:48 smithi135 ceph-mon[24697]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:48.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:48.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:49.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:49.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:49.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:49.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:49.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:49.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:49.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:49.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:49 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:49.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:49.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:49.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:49.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:49.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:49 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:50.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[23769]: Upgrade: Updating mgr.y 2024-09-17T01:05:50.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[23769]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:50.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[23769]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:50.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[28615]: Upgrade: Updating mgr.y 2024-09-17T01:05:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[28615]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[28615]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:50 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:50 smithi135 ceph-mon[24697]: Upgrade: Updating mgr.y 2024-09-17T01:05:50.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:50 smithi135 ceph-mon[24697]: Deploying daemon mgr.y on smithi071 2024-09-17T01:05:50.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:50 smithi135 ceph-mon[24697]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:50.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:50 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:50.977 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:50 smithi071 systemd[1]: Stopping Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:51.255 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:50 smithi071 podman[87447]: 2024-09-17 01:05:50.979238943 +0000 UTC m=+0.129987120 container died 41a7626c1dbf8ca82f5e67287de49abbd71535c5b666dcfb5cc316dafc7c44de (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T01:05:51.633 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:51 smithi071 podman[87447]: 2024-09-17 01:05:51.356376291 +0000 UTC m=+0.507124460 container cleanup 41a7626c1dbf8ca82f5e67287de49abbd71535c5b666dcfb5cc316dafc7c44de (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-17T01:05:51.633 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:51 smithi071 bash[87447]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y 2024-09-17T01:05:51.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:51 smithi071 podman[87458]: 2024-09-17 01:05:51.640982144 +0000 UTC m=+0.657945146 container remove 41a7626c1dbf8ca82f5e67287de49abbd71535c5b666dcfb5cc316dafc7c44de (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:05:51.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:51 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:05:51.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:51 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-17T01:05:51.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:51 smithi071 systemd[1]: Stopped Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:51.897 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:51 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service: Consumed 6.188s CPU time. 2024-09-17T01:05:52.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:52 smithi071 ceph-mon[28615]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:52.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:52 smithi071 ceph-mon[23769]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:52.243 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 systemd[1]: Starting Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:52.252 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:05:52.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:52 smithi135 ceph-mon[24697]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:52.535 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 podman[87620]: 2024-09-17 01:05:52.147523579 +0000 UTC m=+0.020184565 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:52.535 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 podman[87620]: 2024-09-17 01:05:52.285632405 +0000 UTC m=+0.158293370 container create ade93e1db1ada5f8666d09c32ec568f465f1d868e5bed15418796fba50267aa3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T01:05:52.849 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 podman[87620]: 2024-09-17 01:05:52.537731218 +0000 UTC m=+0.410392211 container init ade93e1db1ada5f8666d09c32ec568f465f1d868e5bed15418796fba50267aa3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:05:52.850 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 podman[87620]: 2024-09-17 01:05:52.54199729 +0000 UTC m=+0.414658266 container start ade93e1db1ada5f8666d09c32ec568f465f1d868e5bed15418796fba50267aa3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, ceph=True) 2024-09-17T01:05:52.850 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 ceph-mgr[87665]: -- 172.21.15.71:0/4168640526 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624c75110e0 con 0x5624c74ef000 2024-09-17T01:05:52.850 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 bash[87620]: ade93e1db1ada5f8666d09c32ec568f465f1d868e5bed15418796fba50267aa3 2024-09-17T01:05:52.850 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 systemd[1]: Started Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:52.850 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:52.674+0000 7f111f77b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:05:52.850 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:52.744+0000 7f111f77b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 3s ago 13m - - 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 10s ago 13m - - 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (2m) 3s ago 8m 25.8M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (2m) 10s ago 8m 44.6M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (59s) 3s ago 6m 50.8M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (90s) 10s ago 12m 508M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:05:52.962 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 starting - - - - 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (14m) 3s ago 14m 66.5M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (12m) 10s ago 12m 54.4M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (12m) 3s ago 12m 55.7M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (2m) 3s ago 8m 16.2M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (2m) 10s ago 8m 16.5M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (12m) 3s ago 12m 57.4M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (11m) 3s ago 11m 56.2M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (11m) 3s ago 11m 51.1M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (10m) 3s ago 10m 56.2M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (10m) 10s ago 10m 56.9M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (10m) 10s ago 10m 51.7M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (9m) 10s ago 9m 50.7M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (9m) 10s ago 9m 56.5M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:05:52.963 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (71s) 10s ago 8m 53.8M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:05:52.964 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (6m) 3s ago 6m 75.5M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:05:52.964 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (6m) 10s ago 6m 73.7M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:05:52.964 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (6m) 3s ago 6m 73.6M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:05:52.964 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (6m) 10s ago 6m 73.7M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:05:53.135 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:52.908+0000 7f111f77b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:05:53.135 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:52.979+0000 7f111f77b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:05:53.136 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='client.15672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:53.136 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.136 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.136 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:05:53.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:05:53.383 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15, 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:05:53.384 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:05:53.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:53.145+0000 7f111f77b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:05:53.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:53.296+0000 7f111f77b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:05:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='client.15672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='client.15672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-17T01:05:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-17T01:05:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:53.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:53.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:53.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:53.802 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:05:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:05:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:05:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:05:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [], 2024-09-17T01:05:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "", 2024-09-17T01:05:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:05:53.803 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:05:53.803 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:05:53.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:53.661+0000 7f111f77b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:05:53.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:53.736+0000 7f111f77b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:05:53.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:53.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:54.302 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:54.023+0000 7f111f77b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:05:54.303 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:05:54.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='client.15678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:54.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:54.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='client.25600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:54.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.304 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/4004928102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.305 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.306 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='client.15678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:54.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:54.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='client.25600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:54.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.307 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4004928102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.308 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.310 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.313 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:54 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='client.15678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:54.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:54.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='client.25600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4004928102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:54 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:54.999+0000 7f111f77b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:05:55.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:55.071+0000 7f111f77b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:05:55.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='client.15702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:55.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/791464345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='client.15702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:55.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='client.? 172.21.15.71:0/791464345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.406 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.406 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.406 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.406 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.406 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.407 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.408 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.408 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.408 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.408 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.408 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.408 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.409 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.409 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='client.15702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:05:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/791464345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:55.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:55.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:55.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:55.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:55.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:55 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.123 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:55.845+0000 7f111f77b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:05:56.123 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:55 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:55.972+0000 7f111f77b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:05:56.123 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.125+0000 7f111f77b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:05:56.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.189+0000 7f111f77b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:05:56.397 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.347+0000 7f111f77b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:05:56.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.406 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.408 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.409 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.411 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.412 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.412 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:05:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:56.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:56.716 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.417+0000 7f111f77b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:05:56.717 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.481+0000 7f111f77b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:05:56.717 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.651+0000 7f111f77b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:05:56.717 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.718+0000 7f111f77b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:05:57.001 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.789+0000 7f111f77b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:05:57.001 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.878+0000 7f111f77b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:05:57.001 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:56 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:56.941+0000 7f111f77b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:05:57.001 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:57.003+0000 7f111f77b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:05:57.146 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:05:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:05:56] "GET /metrics HTTP/1.1" 200 38244 "" "Prometheus/2.43.0" 2024-09-17T01:05:57.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.358 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.359 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.360 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.361 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.362 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.363 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.364 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.365 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:57 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:57.952 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:57.848+0000 7f111f77b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:05:57.953 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: [17/Sep/2024:01:05:57] ENGINE Bus STARTING 2024-09-17T01:05:57.953 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: CherryPy Checker: 2024-09-17T01:05:57.953 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: The Application mounted at '' has an empty config. 2024-09-17T01:05:57.953 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:05:58.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: [17/Sep/2024:01:05:57] ENGINE Serving on http://:::9283 2024-09-17T01:05:58.396 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:05:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: [17/Sep/2024:01:05:57] ENGINE Bus STARTED 2024-09-17T01:05:58.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Standby manager daemon y restarted 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Standby manager daemon y restarted 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: Standby manager daemon y started 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:58 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Standby manager daemon y restarted 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/1066626838' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:58.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:58.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:05:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:05:58.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:05:59.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: mgrmap e40: x(active, since 91s), standbys: y 2024-09-17T01:05:59.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: mgrmap e40: x(active, since 91s), standbys: y 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:05:59 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: mgrmap e40: x(active, since 91s), standbys: y 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:59.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:05:59 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:00.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:00 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:00.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:00.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:00.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:00.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:00.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:00 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.312 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.313 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.314 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.316 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.317 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.318 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.318 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:01 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:01.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:01 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:02 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:02.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.248 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:02.249 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.250 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:02.250 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:02 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.502 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.503 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:03.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:03 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:03.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:03.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:04.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:04.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:04.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:04 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-17T01:06:04.436 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.436 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.436 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.436 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.439 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:04.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:04.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:04.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:04.440 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:04 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: Upgrade: It appears safe to stop mon.a 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:05 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: Upgrade: It appears safe to stop mon.a 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.479 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: Upgrade: It appears safe to stop mon.a 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:05.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:05 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[23769]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[23769]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[23769]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[28615]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:06 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:06.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:06 smithi135 ceph-mon[24697]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:06.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:06 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='mgr.x' 2024-09-17T01:06:06.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:06 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:06.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:06 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:06.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:06 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:07.172 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:06:06] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-17T01:06:07.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:07 smithi071 ceph-mon[28615]: Upgrade: Updating mon.a 2024-09-17T01:06:07.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:07 smithi071 ceph-mon[28615]: Deploying daemon mon.a on smithi071 2024-09-17T01:06:07.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:07 smithi071 ceph-mon[23769]: Upgrade: Updating mon.a 2024-09-17T01:06:07.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:07 smithi071 ceph-mon[23769]: Deploying daemon mon.a on smithi071 2024-09-17T01:06:07.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:07 smithi135 ceph-mon[24697]: Upgrade: Updating mon.a 2024-09-17T01:06:07.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:07 smithi135 ceph-mon[24697]: Deploying daemon mon.a on smithi071 2024-09-17T01:06:08.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:08 smithi071 ceph-mon[23769]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:08.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:08 smithi071 ceph-mon[28615]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:08.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:08 smithi135 ceph-mon[24697]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:08.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:08.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:10.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:10 smithi071 ceph-mon[28615]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:10.256 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:09 smithi071 systemd[1]: Stopping Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:10.256 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:10 smithi071 ceph-mon[23769]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:10.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:10 smithi135 ceph-mon[24697]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[23765]: 2024-09-17T01:06:10.257+0000 7fca2f36d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:06:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:10 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[23765]: 2024-09-17T01:06:10.257+0000 7fca2f36d700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T01:06:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:10 smithi071 podman[92533]: 2024-09-17 01:06:10.440887734 +0000 UTC m=+0.307697970 container died f9d5e1454b7798f07c7a28e203681b60aa8b81fee8349e811a7a5fb3fce10965 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, release=754, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., architecture=x86_64, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, ceph=True, vcs-type=git, version=8) 2024-09-17T01:06:11.055 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:10 smithi071 podman[92533]: 2024-09-17 01:06:10.840377794 +0000 UTC m=+0.707187999 container cleanup f9d5e1454b7798f07c7a28e203681b60aa8b81fee8349e811a7a5fb3fce10965 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.19.8, vendor=Red Hat, Inc., release=754, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, name=centos-stream, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, com.redhat.component=centos-stream-container, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True) 2024-09-17T01:06:11.056 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:10 smithi071 bash[92533]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a 2024-09-17T01:06:11.382 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:11 smithi071 podman[92545]: 2024-09-17 01:06:11.05839917 +0000 UTC m=+0.611995004 container remove f9d5e1454b7798f07c7a28e203681b60aa8b81fee8349e811a7a5fb3fce10965 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, RELEASE=HEAD, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, maintainer=Guillaume Abrioux , release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, io.openshift.tags=base centos centos-stream, vcs-type=git, GIT_CLEAN=True, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True) 2024-09-17T01:06:11.382 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:11 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T01:06:11.382 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:11 smithi071 systemd[1]: Stopped Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:11.382 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:11 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service: Consumed 18.973s CPU time. 2024-09-17T01:06:11.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:11 smithi071 systemd[1]: Starting Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:11.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:11 smithi071 podman[92672]: 2024-09-17 01:06:11.495220648 +0000 UTC m=+0.016215056 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:06:12.010 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:11 smithi071 podman[92672]: 2024-09-17 01:06:11.702429516 +0000 UTC m=+0.223423924 container create 227118a9e29831761804d4c34410222a5f1a59994c781ae7995b303b9f31e681 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T01:06:12.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 podman[92672]: 2024-09-17 01:06:12.012532194 +0000 UTC m=+0.533526607 container init 227118a9e29831761804d4c34410222a5f1a59994c781ae7995b303b9f31e681 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-17T01:06:12.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 podman[92672]: 2024-09-17 01:06:12.015874562 +0000 UTC m=+0.536868981 container start 227118a9e29831761804d4c34410222a5f1a59994c781ae7995b303b9f31e681 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:06:12.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:06:12.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:06:12.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: pidfile_write: ignore empty --pid-file 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: load: jerasure load: lrc 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Git sha 0 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: DB SUMMARY 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: DB Session ID: W45FL3CY6OIM7EX09P2O 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: MANIFEST file: MANIFEST-000015 size: 2134 Bytes 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000048.sst 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000046.log size: 95524 ; 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:06:12.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.env: 0x565367278940 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.info_log: 0x56536800f6e0 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.statistics: (nil) 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.use_fsync: 0 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:06:12.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.db_log_dir: 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.wal_dir: 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:06:12.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.write_buffer_manager: 0x56536801e8c0 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:06:12.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.unordered_write: 0 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.row_cache: None 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.wal_filter: None 2024-09-17T01:06:12.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:06:12.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:06:12.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:06:12.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:06:12.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.wal_compression: 0 2024-09-17T01:06:12.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:06:12.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_open_files: -1 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:06:12.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Compression algorithms supported: 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kZSTD supported: 0 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-09-17T01:06:12.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.merge_operator: 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_filter: None 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56536800f320) 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_type: 0 2024-09-17T01:06:12.407 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_index_type: 0 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_shortening: 1 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: checksum: 4 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: no_block_cache: 0 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache: 0x5653680031f0 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_options: 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: capacity : 536870912 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: num_shard_bits : 4 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: strict_capacity_limit : 0 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_compressed: (nil) 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: persistent_cache: (nil) 2024-09-17T01:06:12.408 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size: 4096 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size_deviation: 10 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_restart_interval: 16 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_block_restart_interval: 1 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: metadata_block_size: 4096 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: partition_filters: 0 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: use_delta_encoding: 1 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: filter_policy: bloomfilter 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: whole_key_filtering: 1 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: verify_compression: 0 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: format_version: 5 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_index_compression: 1 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_align: 0 2024-09-17T01:06:12.409 INFO:journalctl@ceph.mon.a.smithi071.stdout: max_auto_readahead_size: 262144 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout: prepopulate_block_cache: 0 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression: NoCompression 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.num_levels: 7 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:06:12.410 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:06:12.411 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:06:12.412 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:06:12.413 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:06:12.414 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.ttl: 2592000 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:06:12.415 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 48.sst 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:06:12.416 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 50, last_sequence is 24259, log_number is 46,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 46 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8e177241-048c-447e-a45b-206cd8fa56bc 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535172043335, "job": 1, "event": "recovery_started", "wal_files": [46]} 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #46 mode 2 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535172044439, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 51, "file_size": 95626, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 24260, "largest_seqno": 24351, "table_properties": {"data_size": 94183, "index_size": 213, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 197, "raw_key_size": 1421, "raw_average_key_size": 24, "raw_value_size": 92940, "raw_average_value_size": 1630, "num_data_blocks": 10, "num_entries": 57, "num_filter_entries": 57, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535172, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8e177241-048c-447e-a45b-206cd8fa56bc", "db_session_id": "W45FL3CY6OIM7EX09P2O", "orig_file_number": 51, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535172044566, "job": 1, "event": "recovery_finished"} 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/version_set.cc:5047] Creating manifest 53 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000046.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x565368030e00 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: DB pointer 0x56536812c000 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:06:12.417 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** DB Stats ** 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:06:12.418 INFO:journalctl@ceph.mon.a.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:06:12.419 INFO:journalctl@ceph.mon.a.smithi071.stdout: L0 1/0 93.38 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:06:12.419 INFO:journalctl@ceph.mon.a.smithi071.stdout: L6 1/0 9.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:06:12.419 INFO:journalctl@ceph.mon.a.smithi071.stdout: Sum 2/0 9.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:06:12.419 INFO:journalctl@ceph.mon.a.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:06:12.419 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:12.419 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:06:12.419 INFO:journalctl@ceph.mon.a.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 127.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:06:12.420 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative compaction: 0.00 GB write, 21.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval compaction: 0.00 GB write, 21.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: Block cache BinnedLRUCache@0x5653680031f0#2 capacity: 512.00 MB usage: 0.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.23 KB,4.47035e-05%) IndexBlock(1,0.30 KB,5.66244e-05%) Misc(1,0.00 KB,0%) 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: starting mon.a rank 0 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???) e3 preinit fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???).mds e1 new map 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???).mds e1 print_map 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: e1 2024-09-17T01:06:12.421 INFO:journalctl@ceph.mon.a.smithi071.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout: legacy client fscid: -1 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout: No filesystems configured 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???).osd e112 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 ceph-mon[92690]: mon.a@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 bash[92672]: 227118a9e29831761804d4c34410222a5f1a59994c781ae7995b303b9f31e681 2024-09-17T01:06:12.422 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:12 smithi071 systemd[1]: Started Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:13.834 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:13.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:13.834 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ignoring --setuser ceph since I am not root 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ignoring --setgroup ceph since I am not root 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mgr[58814]: -- 172.21.15.135:0/3300268533 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561bda9dd0e0 con 0x561bda9ba800 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:13.633+0000 7f82d16e8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:13.689+0000 7f82d16e8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:13.836+0000 7f82d16e8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: mon.a calling monitor election 2024-09-17T01:06:13.835 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: monmap epoch 3 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: min_mon_release 17 (quincy) 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: election_strategy: 1 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: fsmap 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: osdmap e112: 8 total, 8 up, 8 in 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: mgrmap e40: x(active, since 106s), standbys: y 2024-09-17T01:06:13.836 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: overall HEALTH_OK 2024-09-17T01:06:13.837 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: from='mgr.25196 ' entity='' 2024-09-17T01:06:13.837 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-mon[24697]: mgrmap e41: x(active, since 106s), standbys: y 2024-09-17T01:06:13.837 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: ignoring --setuser ceph since I am not root 2024-09-17T01:06:13.837 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: ignoring --setgroup ceph since I am not root 2024-09-17T01:06:13.837 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mgr[87665]: -- 172.21.15.71:0/4199767322 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558df66110e0 con 0x558df65ee800 2024-09-17T01:06:13.837 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:13.636+0000 7fce71abd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:06:13.837 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:13.693+0000 7fce71abd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:13.838+0000 7fce71abd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: mon.a calling monitor election 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: monmap epoch 3 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:13.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: min_mon_release 17 (quincy) 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: election_strategy: 1 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: fsmap 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: osdmap e112: 8 total, 8 up, 8 in 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: mgrmap e40: x(active, since 106s), standbys: y 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: overall HEALTH_OK 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: from='mgr.25196 ' entity='' 2024-09-17T01:06:13.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[92690]: mgrmap e41: x(active, since 106s), standbys: y 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: from='mgr.25196 172.21.15.135:0/1032175832' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: mon.a calling monitor election 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: monmap epoch 3 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: min_mon_release 17 (quincy) 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: election_strategy: 1 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:13.840 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:13.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:13.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: fsmap 2024-09-17T01:06:13.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: osdmap e112: 8 total, 8 up, 8 in 2024-09-17T01:06:13.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: mgrmap e40: x(active, since 106s), standbys: y 2024-09-17T01:06:13.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: overall HEALTH_OK 2024-09-17T01:06:13.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: from='mgr.25196 ' entity='' 2024-09-17T01:06:13.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-mon[28615]: mgrmap e41: x(active, since 106s), standbys: y 2024-09-17T01:06:14.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:13 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:13.904+0000 7fce71abd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:06:14.146 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:14.049+0000 7fce71abd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:06:14.201 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:13.907+0000 7f82d16e8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:06:14.201 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:14.058+0000 7f82d16e8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:06:14.459 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:14.203+0000 7f82d16e8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:06:14.502 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:14.190+0000 7fce71abd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:06:14.791 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:14.537+0000 7f82d16e8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:06:14.791 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:14.600+0000 7f82d16e8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:06:14.791 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:14.792+0000 7f82d16e8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:06:14.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:14.504+0000 7fce71abd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:06:14.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:14.565+0000 7fce71abd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:06:14.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:14 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:14.749+0000 7fce71abd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:06:15.752 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:15 smithi135 ceph-mon[24697]: mgrmap e42: x(active, since 107s), standbys: y 2024-09-17T01:06:15.752 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:15.688+0000 7f82d16e8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:06:15.753 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:15.754+0000 7f82d16e8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:06:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:15 smithi071 ceph-mon[28615]: mgrmap e42: x(active, since 107s), standbys: y 2024-09-17T01:06:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:15 smithi071 ceph-mon[92690]: mgrmap e42: x(active, since 107s), standbys: y 2024-09-17T01:06:15.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:15.636+0000 7fce71abd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:06:15.896 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:15.703+0000 7fce71abd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:06:16.668 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:16.408+0000 7fce71abd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:06:16.668 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:16.526+0000 7fce71abd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:06:16.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:16.455+0000 7f82d16e8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T01:06:16.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:16.573+0000 7f82d16e8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:06:16.948 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:16.670+0000 7fce71abd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:06:16.949 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:16.731+0000 7fce71abd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:06:16.949 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:16.880+0000 7fce71abd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:06:16.949 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:16.950+0000 7fce71abd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:06:16.994 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:16.714+0000 7f82d16e8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:06:16.995 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:16.779+0000 7f82d16e8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:06:16.995 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:16.929+0000 7f82d16e8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T01:06:16.995 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:16.997+0000 7f82d16e8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:06:17.233 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:17.010+0000 7fce71abd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:06:17.233 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:17.169+0000 7fce71abd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:06:17.275 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:17.056+0000 7f82d16e8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:06:17.275 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:17.214+0000 7f82d16e8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:06:17.275 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:17.278+0000 7f82d16e8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:06:17.502 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:17.234+0000 7fce71abd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:06:17.502 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:17.301+0000 7fce71abd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:06:17.502 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:17.383+0000 7fce71abd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:06:17.502 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:17.443+0000 7fce71abd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:06:17.502 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:17 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:17.503+0000 7fce71abd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:06:17.542 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:17.344+0000 7f82d16e8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:06:17.543 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:17.426+0000 7f82d16e8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:06:17.543 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:17.485+0000 7f82d16e8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:06:17.543 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:17.545+0000 7f82d16e8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:06:18.358 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:18.305+0000 7fce71abd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:06:18.358 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: [17/Sep/2024:01:06:18] ENGINE Bus STARTING 2024-09-17T01:06:18.358 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: CherryPy Checker: 2024-09-17T01:06:18.359 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: The Application mounted at '' has an empty config. 2024-09-17T01:06:18.359 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: 2024-09-17T01:06:18.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: [17/Sep/2024:01:06:18] ENGINE Serving on http://:::9283 2024-09-17T01:06:18.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y[87660]: [17/Sep/2024:01:06:18] ENGINE Bus STARTED 2024-09-17T01:06:18.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: Standby manager daemon y restarted 2024-09-17T01:06:18.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: Standby manager daemon y started 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: Active manager daemon x restarted 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: Activating manager daemon x 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: mgrmap e43: x(active, starting, since 0.00682662s), standbys: y 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:06:18.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:06:18.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[28615]: Manager daemon x is now available 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: Standby manager daemon y restarted 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: Standby manager daemon y started 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: Active manager daemon x restarted 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: Activating manager daemon x 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: mgrmap e43: x(active, starting, since 0.00682662s), standbys: y 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:06:18.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:06:18.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:18 smithi071 ceph-mon[92690]: Manager daemon x is now available 2024-09-17T01:06:18.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: Standby manager daemon y restarted 2024-09-17T01:06:18.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: Standby manager daemon y started 2024-09-17T01:06:18.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-17T01:06:18.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:06:18.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-17T01:06:18.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.? 172.21.15.71:0/418210856' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:06:18.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: Active manager daemon x restarted 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: Activating manager daemon x 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: mgrmap e43: x(active, starting, since 0.00682662s), standbys: y 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:06:18.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-mon[24697]: Manager daemon x is now available 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:18.327+0000 7f82d16e8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:06:18] ENGINE Bus STARTING 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: CherryPy Checker: 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: The Application mounted at '' has an empty config. 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:18.692 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:06:18] ENGINE Serving on http://:::9283 2024-09-17T01:06:18.693 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:06:18] ENGINE Bus STARTED 2024-09-17T01:06:19.500 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:19.353+0000 7f82703f1640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-17T01:06:19.500 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:19.500 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.501 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.502 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:19.502 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:19.502 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:19.502 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:19 smithi135 ceph-mon[24697]: mgrmap e44: x(active, since 1.01031s), standbys: y 2024-09-17T01:06:19.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:19.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:06:19.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:19.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[28615]: mgrmap e44: x(active, since 1.01031s), standbys: y 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi071", "caps": []}]: dispatch 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi135", "caps": []}]: dispatch 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:19.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:19.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:19 smithi071 ceph-mon[92690]: mgrmap e44: x(active, since 1.01031s), standbys: y 2024-09-17T01:06:20.387 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:20.128+0000 7f8227e99640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:01:06:20] ENGINE Error in HTTPServer.serve 2024-09-17T01:06:20.388 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: Traceback (most recent call last): 2024-09-17T01:06:20.388 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:06:20.388 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self._connections.run(self.expiration_interval) 2024-09-17T01:06:20.388 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:06:20.388 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self._run(expiration_interval) 2024-09-17T01:06:20.388 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:06:20.389 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:06:20.389 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:06:20.389 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:06:20.389 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:06:20.389 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: s = self.context.wrap_socket( 2024-09-17T01:06:20.390 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:06:20.390 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: return self.sslsocket_class._create( 2024-09-17T01:06:20.390 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:06:20.390 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self.do_handshake() 2024-09-17T01:06:20.390 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:06:20.390 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: self._sslobj.do_handshake() 2024-09-17T01:06:20.391 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:06:20.391 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:20.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:06:20.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:06:20.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:20.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:20.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:06:20.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:06:20.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:20.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:20.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:20 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: [17/Sep/2024:01:06:19] ENGINE Bus STARTING 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: [17/Sep/2024:01:06:20] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: [17/Sep/2024:01:06:20] ENGINE Serving on https://172.21.15.135:7150 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: [17/Sep/2024:01:06:20] ENGINE Bus STARTED 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: [17/Sep/2024:01:06:20] ENGINE Error in HTTPServer.serve 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:06:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.do_handshake() 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:06:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: [17/Sep/2024:01:06:19] ENGINE Bus STARTING 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: [17/Sep/2024:01:06:20] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:06:21.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: [17/Sep/2024:01:06:20] ENGINE Serving on https://172.21.15.135:7150 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: [17/Sep/2024:01:06:20] ENGINE Bus STARTED 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: [17/Sep/2024:01:06:20] ENGINE Error in HTTPServer.serve 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: Traceback (most recent call last): 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._run(expiration_interval) 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: s = self.context.wrap_socket( 2024-09-17T01:06:21.651 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout: return self.sslsocket_class._create( 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout: self.do_handshake() 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout: self._sslobj.do_handshake() 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: mgrmap e45: x(active, since 3s), standbys: y 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: mgrmap e45: x(active, since 3s), standbys: y 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:21 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:06:21.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: [17/Sep/2024:01:06:19] ENGINE Bus STARTING 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: [17/Sep/2024:01:06:20] ENGINE Serving on http://172.21.15.135:8765 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: Updating smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: [17/Sep/2024:01:06:20] ENGINE Serving on https://172.21.15.135:7150 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: [17/Sep/2024:01:06:20] ENGINE Bus STARTED 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: [17/Sep/2024:01:06:20] ENGINE Error in HTTPServer.serve 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout: Traceback (most recent call last): 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._run(expiration_interval) 2024-09-17T01:06:21.675 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: s = self.context.wrap_socket( 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: return self.sslsocket_class._create( 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: self.do_handshake() 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: self._sslobj.do_handshake() 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:06:21.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: Updating smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: mgrmap e45: x(active, since 3s), standbys: y 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:21.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.534 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.535 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.536 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.537 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.538 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.538 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:22.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:22.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:22.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:22.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:22.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:22 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:23.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: mgrmap e46: x(active, since 4s), standbys: y 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.836 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.836 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.838 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: mgrmap e46: x(active, since 4s), standbys: y 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.840 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.841 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.843 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: mgrmap e46: x(active, since 4s), standbys: y 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:23.844 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:23.845 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:23.845 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:23 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.673 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:06:24.673 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.678 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.679 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.680 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.680 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.680 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.680 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.680 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.680 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:24.680 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:24 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-17T01:06:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-17T01:06:25.365 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:06:25.365 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 1s ago 13m - - 2024-09-17T01:06:25.365 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 2s ago 13m - - 2024-09-17T01:06:25.365 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (3m) 1s ago 8m 25.8M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (2m) 2s ago 8m 51.9M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (91s) 1s ago 6m 50.9M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (2m) 2s ago 12m 486M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (33s) 1s ago 14m 437M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (14m) 1s ago 14m 69.3M 2048M 17.2.0 e1d6a67b021e f9d5e1454b77 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (13m) 2s ago 13m 62.1M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (13m) 1s ago 13m 59.4M 2048M 17.2.0 e1d6a67b021e 9b187cb31b4e 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (3m) 1s ago 9m 16.3M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (2m) 2s ago 9m 16.7M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (12m) 1s ago 12m 57.4M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (12m) 1s ago 12m 56.3M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (11m) 1s ago 11m 51.3M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:06:25.366 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (11m) 1s ago 11m 56.2M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (11m) 2s ago 11m 56.1M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (10m) 2s ago 10m 52.0M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (10m) 2s ago 10m 51.5M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (9m) 2s ago 9m 56.7M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (104s) 2s ago 9m 54.0M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (7m) 1s ago 7m 75.6M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (7m) 2s ago 7m 74.0M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (7m) 1s ago 7m 73.6M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:06:25.367 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (7m) 2s ago 7m 74.0M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:06:25.471 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.471 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.471 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.471 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.471 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:25 smithi135 ceph-mon[24697]: Upgrade: It appears safe to stop mon.a 2024-09-17T01:06:25.471 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:25 smithi135 ceph-mon[24697]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[92690]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[92690]: Upgrade: It appears safe to stop mon.a 2024-09-17T01:06:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[92690]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[28615]: Upgrade: It appears safe to stop mon.a 2024-09-17T01:06:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:25 smithi071 ceph-mon[28615]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:06:25.801 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:06:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:06:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-09-17T01:06:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:06:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:06:25.801 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": {}, 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:06:25.802 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:06:26.161 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:06:26.161 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr" 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:06:26.162 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:06:26.563 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:06:26.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-mon[24697]: from='client.25651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-mon[24697]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-mon[24697]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4190993183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:26.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[28615]: from='client.25651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[28615]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[28615]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/4190993183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[92690]: from='client.25651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[92690]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[92690]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:26 smithi071 ceph-mon[92690]: from='client.? 172.21.15.71:0/4190993183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:27.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:06:26] "GET /metrics HTTP/1.1" 200 35449 "" "Prometheus/2.43.0" 2024-09-17T01:06:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[92690]: from='client.25675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[92690]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:06:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[92690]: from='client.? 172.21.15.71:0/3962229184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[92690]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[28615]: from='client.25675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:27.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[28615]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:06:27.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[28615]: from='client.? 172.21.15.71:0/3962229184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:27.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:27 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:27 smithi135 ceph-mon[24697]: from='client.25675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:27 smithi135 ceph-mon[24697]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-09-17T01:06:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:27 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3962229184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:28.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:28.660Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:29.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[28615]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[28615]: Upgrade: Updating mon.a 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[28615]: Deploying daemon mon.a on smithi071 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[92690]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[92690]: Upgrade: Updating mon.a 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[92690]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:29.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:29 smithi071 ceph-mon[92690]: Deploying daemon mon.a on smithi071 2024-09-17T01:06:29.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:29 smithi135 ceph-mon[24697]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:06:29.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:29 smithi135 ceph-mon[24697]: Upgrade: Updating mon.a 2024-09-17T01:06:29.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:29.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:29.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:29.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:29 smithi135 ceph-mon[24697]: Deploying daemon mon.a on smithi071 2024-09-17T01:06:30.559 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:30 smithi071 ceph-mon[92690]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:30.559 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:30 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:30 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:30 smithi071 systemd[1]: Stopping Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:31 smithi135 ceph-mon[24697]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:06:31.744 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:31 smithi071 ceph-mon[28615]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:06:31.745 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:31 smithi071 ceph-mon[92690]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-17T01:06:31.745 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[92686]: 2024-09-17T01:06:31.444+0000 7f1a0a832640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:06:31.745 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[92686]: 2024-09-17T01:06:31.444+0000 7f1a0a832640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T01:06:32.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:31 smithi071 podman[95823]: 2024-09-17 01:06:31.79811757 +0000 UTC m=+0.462799279 container died 227118a9e29831761804d4c34410222a5f1a59994c781ae7995b303b9f31e681 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux ) 2024-09-17T01:06:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:32 smithi071 podman[95823]: 2024-09-17 01:06:32.29723626 +0000 UTC m=+0.961917968 container cleanup 227118a9e29831761804d4c34410222a5f1a59994c781ae7995b303b9f31e681 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T01:06:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:32 smithi071 bash[95823]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a 2024-09-17T01:06:32.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:32 smithi071 podman[95862]: 2024-09-17 01:06:32.524105874 +0000 UTC m=+0.851809139 container remove 227118a9e29831761804d4c34410222a5f1a59994c781ae7995b303b9f31e681 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:06:33.622 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:33 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T01:06:33.622 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:33 smithi071 systemd[1]: Stopped Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:33.622 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:33 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.426s CPU time. 2024-09-17T01:06:33.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:33 smithi071 systemd[1]: Starting Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:33.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:33 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:33.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:34.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 podman[96160]: 2024-09-17 01:06:34.531014145 +0000 UTC m=+0.018639934 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:06:34.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 podman[96160]: 2024-09-17 01:06:34.652100858 +0000 UTC m=+0.139726640 container create 8fbbb2c9095775fe4a50112c5950961fd3d8b415c13dff75579924605fcb7a6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:06:35.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 podman[96160]: 2024-09-17 01:06:34.888169946 +0000 UTC m=+0.375795724 container init 8fbbb2c9095775fe4a50112c5950961fd3d8b415c13dff75579924605fcb7a6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 podman[96160]: 2024-09-17 01:06:34.891563161 +0000 UTC m=+0.379188937 container start 8fbbb2c9095775fe4a50112c5950961fd3d8b415c13dff75579924605fcb7a6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: pidfile_write: ignore empty --pid-file 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: load: jerasure load: lrc 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Git sha 0 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: DB SUMMARY 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: DB Session ID: PAVW6FA7887BFCMRPSOM 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:06:35.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: MANIFEST file: MANIFEST-000053 size: 277 Bytes 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000048.sst 000051.sst 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000052.log size: 2416455 ; 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.env: 0x55dfdd35d940 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.info_log: 0x55dfde2f76e0 2024-09-17T01:06:35.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:06:35.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.statistics: (nil) 2024-09-17T01:06:35.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.use_fsync: 0 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:06:35.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.db_log_dir: 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.wal_dir: 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:06:35.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.write_buffer_manager: 0x55dfde3068c0 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.unordered_write: 0 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:06:35.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.row_cache: None 2024-09-17T01:06:35.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.wal_filter: None 2024-09-17T01:06:35.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:06:35.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:06:35.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:06:35.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:06:35.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.wal_compression: 0 2024-09-17T01:06:35.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:06:35.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:06:35.158 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_open_files: -1 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:06:35.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Compression algorithms supported: 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kZSTD supported: 0 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:06:35.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000053 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.merge_operator: 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_filter: None 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dfde2f7320) 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:06:35.161 INFO:journalctl@ceph.mon.a.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_type: 0 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_index_type: 0 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_shortening: 1 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: checksum: 4 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: no_block_cache: 0 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache: 0x55dfde2eb1f0 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_options: 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: capacity : 536870912 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: num_shard_bits : 4 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: strict_capacity_limit : 0 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:06:35.162 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_cache_compressed: (nil) 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: persistent_cache: (nil) 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size: 4096 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_size_deviation: 10 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_restart_interval: 16 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: index_block_restart_interval: 1 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: metadata_block_size: 4096 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: partition_filters: 0 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: use_delta_encoding: 1 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: filter_policy: bloomfilter 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: whole_key_filtering: 1 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: verify_compression: 0 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: format_version: 5 2024-09-17T01:06:35.163 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_index_compression: 1 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout: block_align: 0 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout: max_auto_readahead_size: 262144 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout: prepopulate_block_cache: 0 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression: NoCompression 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:06:35.164 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.num_levels: 7 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:06:35.165 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:06:35.166 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:06:35.167 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:06:35.168 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:06:35.169 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.ttl: 2592000 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:06:35.170 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 48.sst 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000053 succeeded,manifest_file_number is 53, next_file_number is 55, last_sequence is 24351, log_number is 47,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 47 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 47 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8e177241-048c-447e-a45b-206cd8fa56bc 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535194917922, "job": 1, "event": "recovery_started", "wal_files": [52]} 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #52 mode 2 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535194925183, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 56, "file_size": 2294227, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 24354, "largest_seqno": 25275, "table_properties": {"data_size": 2289429, "index_size": 2474, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 12265, "raw_average_key_size": 24, "raw_value_size": 2279609, "raw_average_value_size": 4461, "num_data_blocks": 110, "num_entries": 511, "num_filter_entries": 511, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535194, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8e177241-048c-447e-a45b-206cd8fa56bc", "db_session_id": "PAVW6FA7887BFCMRPSOM", "orig_file_number": 56, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:06:35.171 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535194925278, "job": 1, "event": "recovery_finished"} 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/version_set.cc:5047] Creating manifest 58 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000052.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dfde318e00 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: DB pointer 0x55dfde414000 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** DB Stats ** 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:06:35.172 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: L0 2/0 2.28 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 598.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: L6 1/0 9.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: Sum 3/0 11.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 598.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 598.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:06:35.173 INFO:journalctl@ceph.mon.a.smithi071.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 598.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: Cumulative compaction: 0.00 GB write, 189.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: Interval compaction: 0.00 GB write, 189.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:06:35.174 INFO:journalctl@ceph.mon.a.smithi071.stdout: Block cache BinnedLRUCache@0x55dfde2eb1f0#2 capacity: 512.00 MB usage: 4.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.64 KB,0.000312924%) IndexBlock(2,2.88 KB,0.000548363%) Misc(1,0.00 KB,0%) 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: starting mon.a rank 0 at public addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] at bind addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???) e3 preinit fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???).mds e1 new map 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???).mds e1 print_map 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: e1 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: legacy client fscid: -1 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: 2024-09-17T01:06:35.175 INFO:journalctl@ceph.mon.a.smithi071.stdout: No filesystems configured 2024-09-17T01:06:35.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-17T01:06:35.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:35.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:35.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:35.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 ceph-mon[96259]: mon.a@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-09-17T01:06:35.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 bash[96160]: 8fbbb2c9095775fe4a50112c5950961fd3d8b415c13dff75579924605fcb7a6a 2024-09-17T01:06:35.176 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:34 smithi071 systemd[1]: Started Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:36.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:36.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:36.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:36.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: mon.a calling monitor election 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: monmap epoch 3 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: min_mon_release 17 (quincy) 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: election_strategy: 1 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: fsmap 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:36.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: mgrmap e46: x(active, since 18s), standbys: y 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: overall HEALTH_OK 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='' 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='' 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: mon.a calling monitor election 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: monmap epoch 3 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: min_mon_release 17 (quincy) 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: election_strategy: 1 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: fsmap 2024-09-17T01:06:36.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: mgrmap e46: x(active, since 18s), standbys: y 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: overall HEALTH_OK 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='' 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='' 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:36.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:36 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:36.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:36.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:36.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:36.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: mon.a calling monitor election 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: monmap epoch 3 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: min_mon_release 17 (quincy) 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: election_strategy: 1 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: fsmap 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: mgrmap e46: x(active, since 18s), standbys: y 2024-09-17T01:06:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: overall HEALTH_OK 2024-09-17T01:06:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='' 2024-09-17T01:06:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='' 2024-09-17T01:06:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:06:36] "GET /metrics HTTP/1.1" 200 38260 "" "Prometheus/2.43.0" 2024-09-17T01:06:37.572 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:37.572 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:37.572 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.572 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.573 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.574 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.575 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.576 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.578 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:37 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T01:06:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:37 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:38 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:38.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:38.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:38 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.530 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.532 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.533 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.536 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.536 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.536 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.536 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:39 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:39.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:39.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:39.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:39.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:39.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:39 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.599 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.601 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.603 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.605 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.606 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.607 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:40 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:41 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:41.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:41.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:41.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:41 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:42 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:42.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:42.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:42.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:42.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:42.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:42.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:42 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:43 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.673 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:43.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:43.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.674 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.675 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.676 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.677 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:43.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:43.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:43.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:43.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:43 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.592 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.592 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.594 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:44 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:44.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:44.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:44.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:44.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:44 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:45 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.680 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.680 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.680 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.680 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.681 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.682 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.683 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.684 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.685 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.686 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.687 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.688 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:45.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:45.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:45.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:45.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:45.689 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:45 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:46 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:46.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:46.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:46.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:46.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:06:46.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-17T01:06:46.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:46.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:47.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:06:46] "GET /metrics HTTP/1.1" 200 38260 "" "Prometheus/2.43.0" 2024-09-17T01:06:47.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:47 smithi071 ceph-mon[96259]: Upgrade: It appears safe to stop mon.c 2024-09-17T01:06:47.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:47 smithi071 ceph-mon[96259]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:47.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:47 smithi071 ceph-mon[28615]: Upgrade: It appears safe to stop mon.c 2024-09-17T01:06:47.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:47 smithi071 ceph-mon[28615]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:47 smithi135 ceph-mon[24697]: Upgrade: It appears safe to stop mon.c 2024-09-17T01:06:47.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:47 smithi135 ceph-mon[24697]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:48.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:48.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: Upgrade: Updating mon.c 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: Deploying daemon mon.c on smithi071 2024-09-17T01:06:49.632 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[28615]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:49.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:49.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: Upgrade: Updating mon.c 2024-09-17T01:06:49.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:49.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:49.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:49.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:49.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: Deploying daemon mon.c on smithi071 2024-09-17T01:06:49.634 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: Upgrade: Updating mon.c 2024-09-17T01:06:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: Deploying daemon mon.c on smithi071 2024-09-17T01:06:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:49 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:50.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:50 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:50 smithi071 ceph-mon[28615]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:50.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:50 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:06:51.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:51 smithi071 ceph-mon[96259]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:51 smithi071 systemd[1]: Stopping Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:51.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:51 smithi071 ceph-mon[28615]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:51.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:51 smithi135 ceph-mon[24697]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:51.993 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c[28593]: 2024-09-17T01:06:51.739+0000 7f89e1edf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:06:51.993 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c[28593]: 2024-09-17T01:06:51.740+0000 7f89e1edf700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T01:06:52.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:51 smithi071 podman[100318]: 2024-09-17 01:06:51.995887388 +0000 UTC m=+0.481442481 container stop 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, io.buildah.version=1.19.8, version=8, ceph=True, architecture=x86_64, release=754, GIT_CLEAN=True, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-09-17T01:06:52.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:52 smithi071 podman[100318]: 2024-09-17 01:06:52.021505743 +0000 UTC m=+0.507060836 container died 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, io.openshift.expose-services=, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, ceph=True, distribution-scope=public, io.openshift.tags=base centos centos-stream, vcs-type=git, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, maintainer=Guillaume Abrioux , name=centos-stream, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64) 2024-09-17T01:06:52.563 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:52 smithi071 podman[100318]: 2024-09-17 01:06:52.389824072 +0000 UTC m=+0.875379156 container cleanup 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, vcs-type=git, vendor=Red Hat, Inc., io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=HEAD, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, com.redhat.component=centos-stream-container) 2024-09-17T01:06:52.563 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:52 smithi071 bash[100318]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c 2024-09-17T01:06:52.821 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:52 smithi071 podman[100332]: 2024-09-17 01:06:52.566079514 +0000 UTC m=+0.564087815 container remove 9b187cb31b4e4e4a27ecfcb1744c0c00a2f3e3568da6b1b4a36f6c2979642af3 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, io.openshift.expose-services=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, version=8, RELEASE=HEAD, distribution-scope=public, vcs-type=git) 2024-09-17T01:06:52.821 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:52 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-17T01:06:52.821 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:52 smithi071 systemd[1]: Stopped Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:52.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:52 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.c.service: Consumed 11.438s CPU time. 2024-09-17T01:06:53.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 systemd[1]: Starting Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:53.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 podman[100460]: 2024-09-17 01:06:53.127449875 +0000 UTC m=+0.016469424 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:06:53.475 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 podman[100460]: 2024-09-17 01:06:53.267909159 +0000 UTC m=+0.156928698 container create 11dc09c7db4e1abfc08359e7255cfe46744ba613baffe90ec90d1a9160fc01ba (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97) 2024-09-17T01:06:53.476 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 podman[100460]: 2024-09-17 01:06:53.478599705 +0000 UTC m=+0.367619245 container init 11dc09c7db4e1abfc08359e7255cfe46744ba613baffe90ec90d1a9160fc01ba (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T01:06:53.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 podman[100460]: 2024-09-17 01:06:53.48173647 +0000 UTC m=+0.370756004 container start 11dc09c7db4e1abfc08359e7255cfe46744ba613baffe90ec90d1a9160fc01ba (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:06:53.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: pidfile_write: ignore empty --pid-file 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: load: jerasure load: lrc 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Git sha 0 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: DB SUMMARY 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: DB Session ID: J0SSWD8EOJIKUHBNX7QF 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: MANIFEST file: MANIFEST-000009 size: 2059 Bytes 2024-09-17T01:06:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000042.sst 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000040.log size: 5312663 ; 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.env: 0x560edfcbf940 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.info_log: 0x560ee09e96e0 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.statistics: (nil) 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.use_fsync: 0 2024-09-17T01:06:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:06:53.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:06:53.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:06:53.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:06:53.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:06:53.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:06:53.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:06:53.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:06:53.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:06:53.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:06:53.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.db_log_dir: 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.wal_dir: 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.write_buffer_manager: 0x560ee09f88c0 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:06:53.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.unordered_write: 0 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.row_cache: None 2024-09-17T01:06:53.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.wal_filter: None 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.wal_compression: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:06:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:06:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_open_files: -1 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Compression algorithms supported: 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kZSTD supported: 0 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:06:53.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.merge_operator: 2024-09-17T01:06:53.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_filter: None 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560ee09e9320) 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_type: 0 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: data_block_index_type: 0 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_shortening: 1 2024-09-17T01:06:53.907 INFO:journalctl@ceph.mon.c.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: checksum: 4 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: no_block_cache: 0 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache: 0x560ee09dd1f0 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_options: 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: capacity : 536870912 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: num_shard_bits : 4 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: strict_capacity_limit : 0 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_compressed: (nil) 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: persistent_cache: (nil) 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_size: 4096 2024-09-17T01:06:53.908 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_size_deviation: 10 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_restart_interval: 16 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_block_restart_interval: 1 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: metadata_block_size: 4096 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: partition_filters: 0 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: use_delta_encoding: 1 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: filter_policy: bloomfilter 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: whole_key_filtering: 1 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: verify_compression: 0 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: format_version: 5 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: enable_index_compression: 1 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_align: 0 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: max_auto_readahead_size: 262144 2024-09-17T01:06:53.909 INFO:journalctl@ceph.mon.c.smithi071.stdout: prepopulate_block_cache: 0 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression: NoCompression 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.num_levels: 7 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:06:53.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:06:53.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:06:53.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:06:53.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:06:53.914 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.ttl: 2592000 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:06:53.915 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 42.sst 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 44, last_sequence is 25825, log_number is 40,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 40 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5010cb03-0d7f-48ad-958e-c69ab738895a 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535213507559, "job": 1, "event": "recovery_started", "wal_files": [40]} 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #40 mode 2 2024-09-17T01:06:53.916 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535213519892, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 45, "file_size": 3155135, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 25830, "largest_seqno": 28664, "table_properties": {"data_size": 3145659, "index_size": 4653, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3781, "raw_key_size": 34516, "raw_average_key_size": 22, "raw_value_size": 3120364, "raw_average_value_size": 2077, "num_data_blocks": 195, "num_entries": 1502, "num_filter_entries": 1502, "num_deletions": 258, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535213, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5010cb03-0d7f-48ad-958e-c69ab738895a", "db_session_id": "J0SSWD8EOJIKUHBNX7QF", "orig_file_number": 45, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535213520016, "job": 1, "event": "recovery_finished"} 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/version_set.cc:5047] Creating manifest 47 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000040.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560ee0a0ae00 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: DB pointer 0x560ee0b06000 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** DB Stats ** 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:06:53.917 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: L0 1/0 3.01 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 626.1 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: L6 1/0 9.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: Sum 2/0 12.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 626.1 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 626.1 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:06:53.918 INFO:journalctl@ceph.mon.c.smithi071.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 626.1 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative compaction: 0.00 GB write, 179.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval compaction: 0.00 GB write, 179.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:06:53.919 INFO:journalctl@ceph.mon.c.smithi071.stdout: Block cache BinnedLRUCache@0x560ee09dd1f0#2 capacity: 512.00 MB usage: 9.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: starting mon.c rank 1 at public addrs [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] at bind addrs [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???) e3 preinit fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???).mds e1 new map 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???).mds e1 print_map 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: e1 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: legacy client fscid: -1 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:06:53.920 INFO:journalctl@ceph.mon.c.smithi071.stdout: No filesystems configured 2024-09-17T01:06:53.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-17T01:06:53.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:53.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:53.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:06:53.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 ceph-mon[100478]: mon.c@-1(???).paxosservice(auth 1..26) refresh upgraded, format 0 -> 3 2024-09-17T01:06:53.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 bash[100460]: 11dc09c7db4e1abfc08359e7255cfe46744ba613baffe90ec90d1a9160fc01ba 2024-09-17T01:06:53.921 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:53 smithi071 systemd[1]: Started Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:53.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:53.506Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:55.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:55.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: mon.c calling monitor election 2024-09-17T01:06:55.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: mon.a calling monitor election 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: monmap epoch 3 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: min_mon_release 17 (quincy) 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: election_strategy: 1 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: fsmap 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: mgrmap e46: x(active, since 35s), standbys: y 2024-09-17T01:06:55.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: overall HEALTH_OK 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.095 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:55.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: mon.c calling monitor election 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: mon.a calling monitor election 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: monmap epoch 3 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: min_mon_release 17 (quincy) 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: election_strategy: 1 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: fsmap 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:55.097 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: mgrmap e46: x(active, since 35s), standbys: y 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: overall HEALTH_OK 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.098 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.104 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:54 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: mon.c calling monitor election 2024-09-17T01:06:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: mon.a calling monitor election 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: monmap epoch 3 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: min_mon_release 17 (quincy) 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: election_strategy: 1 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: fsmap 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:06:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: mgrmap e46: x(active, since 35s), standbys: y 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: overall HEALTH_OK 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:54 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.874 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.876 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:55.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:55.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:55.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:55.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:55.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:55.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:55 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:55 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:56.953 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:06:57.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.157 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:56 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:06:56] "GET /metrics HTTP/1.1" 200 38258 "" "Prometheus/2.43.0" 2024-09-17T01:06:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:56 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.650 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:06:57.650 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 11s ago 14m - - 2024-09-17T01:06:57.650 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 11s ago 14m - - 2024-09-17T01:06:57.650 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (3m) 11s ago 9m 25.8M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (3m) 11s ago 9m 50.8M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (2m) 11s ago 7m 53.8M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (2m) 11s ago 13m 495M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (65s) 11s ago 15m 438M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (23s) 11s ago 15m 33.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (13m) 11s ago 13m 61.0M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 starting - - - 2048M 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (3m) 11s ago 9m 15.7M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (3m) 11s ago 9m 17.2M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (13m) 11s ago 13m 57.7M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (12m) 11s ago 12m 56.6M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (12m) 11s ago 12m 51.5M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:06:57.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (12m) 11s ago 12m 56.9M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (11m) 11s ago 11m 56.2M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (11m) 11s ago 11m 52.2M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (10m) 11s ago 10m 51.6M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (10m) 11s ago 10m 56.8M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (2m) 11s ago 9m 54.1M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (7m) 11s ago 7m 75.9M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (7m) 11s ago 7m 74.1M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (7m) 11s ago 7m 73.9M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:06:57.652 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (7m) 11s ago 7m 74.1M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:06:57.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.857 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.858 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.859 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.860 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.863 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.864 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:57.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:57.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:57.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:57.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:57.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:57 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.068 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:06:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:06:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-17T01:06:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:06:58.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:06:58.069 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:06:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:57 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.416 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:06:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:06:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr" 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "3/23 daemons upgraded", 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:06:58.417 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:06:58.773 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.848 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:06:58.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:06:58.532+0000 7f82703f1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T01:06:58.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:06:58.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:06:58.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:58.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/3308395218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:58.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:58.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:58.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:58.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:58.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:58.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:58 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:59.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='client.? 172.21.15.71:0/3308395218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3308395218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.096 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:06:59.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:59.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:59.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:59.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:59.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:58 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='client.? 172.21.15.71:0/2311562279' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2311562279' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:06:59 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/2311562279' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:06:59 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.036 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.037 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.038 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.039 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.040 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.041 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.042 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.043 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:00 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:00 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:01.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:01.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:01 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:01 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:02.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:02.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:02.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:02 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.030 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.030 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.031 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.032 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.033 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:03.034 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:03.035 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:02 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:03.784 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:03.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:04.091 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.091 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.091 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.092 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.092 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.092 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.092 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.092 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.092 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.093 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.093 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.093 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.093 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.093 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.093 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.094 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.094 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.094 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.094 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.094 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.095 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.095 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.095 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.095 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.095 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.095 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.096 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.096 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.096 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.097 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.097 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.097 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.097 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:04.097 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.098 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.098 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.098 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.098 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.098 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.098 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.098 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.099 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.099 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.099 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.099 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.099 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.099 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.100 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.100 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:03 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.138 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.141 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.141 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.141 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.141 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.144 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.145 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:03 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:04.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:04.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:04.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:04.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:04 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.053 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.054 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.055 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.055 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.055 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.055 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.055 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.056 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.057 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.058 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.059 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.060 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:04 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:05.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:05.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:05 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:05 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.109 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:07:07.110 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: Upgrade: It appears safe to stop mon.c 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[96259]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.111 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.112 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.113 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.113 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:07:07.113 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.113 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-17T01:07:07.113 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: Upgrade: It appears safe to stop mon.c 2024-09-17T01:07:07.113 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:06 smithi071 ceph-mon[100478]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:07:06] "GET /metrics HTTP/1.1" 200 38272 "" "Prometheus/2.43.0" 2024-09-17T01:07:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: Upgrade: It appears safe to stop mon.c 2024-09-17T01:07:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:06 smithi135 ceph-mon[24697]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:08.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:08.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:09 smithi135 ceph-mon[24697]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:09 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:09 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:09 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[96259]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[100478]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:09 smithi071 ceph-mon[100478]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:10 smithi071 ceph-mon[96259]: Upgrade: Updating mon.c 2024-09-17T01:07:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:10 smithi071 ceph-mon[96259]: Deploying daemon mon.c on smithi071 2024-09-17T01:07:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:10 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:10.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:10 smithi071 ceph-mon[100478]: Upgrade: Updating mon.c 2024-09-17T01:07:10.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:10 smithi071 ceph-mon[100478]: Deploying daemon mon.c on smithi071 2024-09-17T01:07:10.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:10 smithi071 ceph-mon[100478]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:10 smithi135 ceph-mon[24697]: Upgrade: Updating mon.c 2024-09-17T01:07:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:10 smithi135 ceph-mon[24697]: Deploying daemon mon.c on smithi071 2024-09-17T01:07:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:10 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:11 smithi135 ceph-mon[24697]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:11.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:11 smithi071 ceph-mon[96259]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:11.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:11 smithi071 ceph-mon[100478]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:12.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:12 smithi071 systemd[1]: Stopping Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:12.791 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c[100474]: 2024-09-17T01:07:12.409+0000 7f87449ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:07:12.792 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c[100474]: 2024-09-17T01:07:12.409+0000 7f87449ce640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T01:07:12.792 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:12 smithi071 podman[105447]: 2024-09-17 01:07:12.511938503 +0000 UTC m=+0.242776981 container died 11dc09c7db4e1abfc08359e7255cfe46744ba613baffe90ec90d1a9160fc01ba (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T01:07:13.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:12 smithi071 podman[105447]: 2024-09-17 01:07:12.893558109 +0000 UTC m=+0.624396596 container cleanup 11dc09c7db4e1abfc08359e7255cfe46744ba613baffe90ec90d1a9160fc01ba (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97) 2024-09-17T01:07:13.109 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:12 smithi071 bash[105447]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c 2024-09-17T01:07:13.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 podman[105518]: 2024-09-17 01:07:13.111715317 +0000 UTC m=+0.601343211 container remove 11dc09c7db4e1abfc08359e7255cfe46744ba613baffe90ec90d1a9160fc01ba (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:07:13.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-17T01:07:13.369 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 systemd[1]: Stopped Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:13.370 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.c.service: Consumed 1.271s CPU time. 2024-09-17T01:07:13.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 systemd[1]: Starting Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:13.938 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 podman[105645]: 2024-09-17 01:07:13.582738698 +0000 UTC m=+0.015634822 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:07:13.938 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 podman[105645]: 2024-09-17 01:07:13.704979622 +0000 UTC m=+0.137875741 container create 801a38ec49997a6a0fc566c3c3e51c70f4d392073e9ebc0431dca1aa920cceed (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:07:13.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:13.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:14.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 podman[105645]: 2024-09-17 01:07:13.941011975 +0000 UTC m=+0.373908113 container init 801a38ec49997a6a0fc566c3c3e51c70f4d392073e9ebc0431dca1aa920cceed (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:07:14.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 podman[105645]: 2024-09-17 01:07:13.944674442 +0000 UTC m=+0.377570563 container start 801a38ec49997a6a0fc566c3c3e51c70f4d392073e9ebc0431dca1aa920cceed (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: pidfile_write: ignore empty --pid-file 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: load: jerasure load: lrc 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Git sha 0 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: DB SUMMARY 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: DB Session ID: JCLVEZSABJ9Z5NTCFQSX 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:07:14.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: MANIFEST file: MANIFEST-000047 size: 517 Bytes 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000052.sst 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000050.log size: 1366644 ; 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.env: 0x557265522940 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.info_log: 0x5572662036e0 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:07:14.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.statistics: (nil) 2024-09-17T01:07:14.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.use_fsync: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:07:14.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.db_log_dir: 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.wal_dir: 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.write_buffer_manager: 0x5572662128c0 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:07:14.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.unordered_write: 0 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.row_cache: None 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.wal_filter: None 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:07:14.243 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.wal_compression: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:07:14.244 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:07:14.245 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_open_files: -1 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Compression algorithms supported: 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kZSTD supported: 0 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:07:14.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:07:14.248 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:07:14.248 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:07:14.248 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:07:14.248 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000047 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.merge_operator: 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_filter: None 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557266203320) 2024-09-17T01:07:14.249 INFO:journalctl@ceph.mon.c.smithi071.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_type: 0 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: data_block_index_type: 0 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_shortening: 1 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: checksum: 4 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: no_block_cache: 0 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache: 0x5572661f71f0 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_options: 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: capacity : 536870912 2024-09-17T01:07:14.250 INFO:journalctl@ceph.mon.c.smithi071.stdout: num_shard_bits : 4 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: strict_capacity_limit : 0 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_cache_compressed: (nil) 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: persistent_cache: (nil) 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_size: 4096 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_size_deviation: 10 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_restart_interval: 16 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: index_block_restart_interval: 1 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: metadata_block_size: 4096 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: partition_filters: 0 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: use_delta_encoding: 1 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: filter_policy: bloomfilter 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: whole_key_filtering: 1 2024-09-17T01:07:14.251 INFO:journalctl@ceph.mon.c.smithi071.stdout: verify_compression: 0 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: format_version: 5 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: enable_index_compression: 1 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: block_align: 0 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: max_auto_readahead_size: 262144 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: prepopulate_block_cache: 0 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression: NoCompression 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:07:14.252 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.num_levels: 7 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:07:14.253 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:07:14.254 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:07:14.255 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:07:14.256 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:07:14.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.ttl: 2592000 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:07:14.258 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000047 succeeded,manifest_file_number is 47, next_file_number is 54, last_sequence is 29376, log_number is 50,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 50 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 50 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5010cb03-0d7f-48ad-958e-c69ab738895a 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535233971283, "job": 1, "event": "recovery_started", "wal_files": [50]} 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #50 mode 2 2024-09-17T01:07:14.259 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535233975913, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 55, "file_size": 873380, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 29381, "largest_seqno": 30719, "table_properties": {"data_size": 868371, "index_size": 2112, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 17800, "raw_average_key_size": 24, "raw_value_size": 856287, "raw_average_value_size": 1176, "num_data_blocks": 85, "num_entries": 728, "num_filter_entries": 728, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535233, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5010cb03-0d7f-48ad-958e-c69ab738895a", "db_session_id": "JCLVEZSABJ9Z5NTCFQSX", "orig_file_number": 55, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535233976020, "job": 1, "event": "recovery_finished"} 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/version_set.cc:5047] Creating manifest 57 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000050.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557266224e00 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: DB pointer 0x557266320000 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** DB Stats ** 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:07:14.260 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: L0 1/0 852.91 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 356.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: L6 1/0 11.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: Sum 2/0 12.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 356.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 356.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** Compaction Stats [default] ** 2024-09-17T01:07:14.261 INFO:journalctl@ceph.mon.c.smithi071.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 356.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: Cumulative compaction: 0.00 GB write, 121.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:07:14.262 INFO:journalctl@ceph.mon.c.smithi071.stdout: Interval compaction: 0.00 GB write, 121.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: Block cache BinnedLRUCache@0x5572661f71f0#2 capacity: 512.00 MB usage: 4.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: starting mon.c rank 1 at public addrs [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] at bind addrs [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???) e3 preinit fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???).mds e1 new map 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???).mds e1 print_map 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: e1 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:07:14.263 INFO:journalctl@ceph.mon.c.smithi071.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout: legacy client fscid: -1 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout: 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout: No filesystems configured 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:13 smithi071 ceph-mon[105664]: mon.c@-1(???).paxosservice(auth 1..27) refresh upgraded, format 0 -> 3 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:14 smithi071 bash[105645]: 801a38ec49997a6a0fc566c3c3e51c70f4d392073e9ebc0431dca1aa920cceed 2024-09-17T01:07:14.264 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:14 smithi071 systemd[1]: Started Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:15.615 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:15.615 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: mon.c calling monitor election 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: mon.a calling monitor election 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: monmap epoch 3 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: min_mon_release 17 (quincy) 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: election_strategy: 1 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:15.616 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:15.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: fsmap 2024-09-17T01:07:15.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:15.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: mgrmap e46: x(active, since 56s), standbys: y 2024-09-17T01:07:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: overall HEALTH_OK 2024-09-17T01:07:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='' 2024-09-17T01:07:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: mon.c calling monitor election 2024-09-17T01:07:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: mon.a calling monitor election 2024-09-17T01:07:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: monmap epoch 3 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: min_mon_release 17 (quincy) 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: election_strategy: 1 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: fsmap 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: mgrmap e46: x(active, since 56s), standbys: y 2024-09-17T01:07:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: overall HEALTH_OK 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='' 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:15 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: mon.c calling monitor election 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: mon.a calling monitor election 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: monmap epoch 3 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: last_changed 2024-09-17T00:53:12.085085+0000 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: min_mon_release 17 (quincy) 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: election_strategy: 1 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:15.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: fsmap 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: mgrmap e46: x(active, since 56s), standbys: y 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: overall HEALTH_OK 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='' 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:15.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:15 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:07:16] "GET /metrics HTTP/1.1" 200 38272 "" "Prometheus/2.43.0" 2024-09-17T01:07:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:16.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:16 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:17 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:17.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:17.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:17.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:17.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:17.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:17 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:18.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:18.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:18 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.626 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.627 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:19 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:19 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.798 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.799 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.799 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.799 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.799 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.799 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.799 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.800 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.805 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.806 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.807 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.807 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.807 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.807 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.807 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.808 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.809 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.810 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.812 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.813 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:20 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:20 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:21 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:21 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:22 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.907 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.908 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.909 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.910 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:22.911 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:22 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:23 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.959 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:23.506Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:23 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.780 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.780 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.780 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.781 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.782 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.783 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.784 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.785 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.786 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.787 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.788 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:24 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:24 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.863 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:25 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:26 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:07:26] "GET /metrics HTTP/1.1" 200 38205 "" "Prometheus/2.43.0" 2024-09-17T01:07:26.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:26.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:26.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:26.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:26.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:26.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:26.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:26 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:27.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:27.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:27.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:27 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:28 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:28.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:28.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:28.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:28.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:28.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:28.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:28.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:28 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.229 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:29 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.916 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:07:29.916 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 17s ago 14m - - 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 3s ago 14m - - 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (4m) 17s ago 9m 24.9M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (3m) 3s ago 9m 51.5M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (2m) 17s ago 7m 54.0M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (3m) 3s ago 14m 503M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (97s) 17s ago 15m 439M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (55s) 17s ago 15m 41.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (14m) 3s ago 14m 63.9M 2048M 17.2.0 e1d6a67b021e 87badd5ae073 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 starting - - - 2048M 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (4m) 17s ago 10m 15.7M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (3m) 3s ago 10m 16.6M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (13m) 17s ago 13m 58.0M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (13m) 17s ago 13m 56.7M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:07:29.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (12m) 17s ago 12m 51.9M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (12m) 17s ago 12m 57.1M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (12m) 3s ago 12m 56.5M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (11m) 3s ago 11m 52.4M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (11m) 3s ago 11m 51.8M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (11m) 3s ago 11m 57.0M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (2m) 3s ago 10m 54.5M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (8m) 17s ago 8m 76.0M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (8m) 3s ago 8m 74.4M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (8m) 17s ago 8m 74.1M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:07:29.918 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (8m) 3s ago 8m 74.2M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:07:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:29 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.384 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:07:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:07:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-17T01:07:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-09-17T01:07:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:07:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:07:30.386 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:07:30.751 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr" 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "4/23 daemons upgraded", 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:07:30.752 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:07:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/4091322713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:30.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:30.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:30.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:30.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:07:30.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:30 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-17T01:07:31.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:31.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/4091322713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/4091322713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:07:31.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-17T01:07:31.159 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:07:31.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:31 smithi071 ceph-mon[96259]: Upgrade: It appears safe to stop mon.b 2024-09-17T01:07:31.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:31 smithi071 ceph-mon[96259]: from='client.64126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:31.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:31 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1938660224' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:31.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:31 smithi071 ceph-mon[105664]: Upgrade: It appears safe to stop mon.b 2024-09-17T01:07:31.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:31 smithi071 ceph-mon[105664]: from='client.64126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:31.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:31 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1938660224' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:31.958 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:31 smithi135 ceph-mon[24697]: Upgrade: It appears safe to stop mon.b 2024-09-17T01:07:31.958 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:31 smithi135 ceph-mon[24697]: from='client.64126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:31.958 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:31 smithi135 ceph-mon[24697]: from='client.? 172.21.15.71:0/1938660224' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: Upgrade: Updating mon.b 2024-09-17T01:07:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: Deploying daemon mon.b on smithi135 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[96259]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: Upgrade: Updating mon.b 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:33.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:33.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:33.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: Deploying daemon mon.b on smithi135 2024-09-17T01:07:33.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:33.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:33 smithi071 ceph-mon[105664]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: Upgrade: Updating mon.b 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: Deploying daemon mon.b on smithi135 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.391 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-mon[24697]: from='mgr.25406 ' entity='mgr.x' 2024-09-17T01:07:33.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:33 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:33.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:33 smithi135 systemd[1]: Stopping Ceph mon.b for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:34.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-mon[24697]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:34.340 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:34.340 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:34.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b[24680]: 2024-09-17T01:07:34.231+0000 7f343ff06700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:07:34.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b[24680]: 2024-09-17T01:07:34.231+0000 7f343ff06700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-17T01:07:34.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:34 smithi135 podman[88941]: 2024-09-17 01:07:34.303214594 +0000 UTC m=+0.201588747 container died 87badd5ae073ea13a7fe54cea20190a5172938479f5fd4367e3fec025cd3bb5b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , ceph=True, architecture=x86_64, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, io.openshift.expose-services=, release=754, vendor=Red Hat, Inc.) 2024-09-17T01:07:34.589 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:07:34] ENGINE Bus STOPPING 2024-09-17T01:07:34.589 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:07:34] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:07:34.590 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:07:34] ENGINE Bus STOPPED 2024-09-17T01:07:34.590 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:07:34] ENGINE Bus STARTING 2024-09-17T01:07:34.590 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:07:34] ENGINE Serving on http://:::9283 2024-09-17T01:07:34.590 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:07:34] ENGINE Bus STARTED 2024-09-17T01:07:34.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:34 smithi135 podman[88941]: 2024-09-17 01:07:34.681871431 +0000 UTC m=+0.580245582 container cleanup 87badd5ae073ea13a7fe54cea20190a5172938479f5fd4367e3fec025cd3bb5b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, version=8, io.openshift.tags=base centos centos-stream, name=centos-stream, ceph=True, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, release=754, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, vcs-type=git, com.redhat.component=centos-stream-container) 2024-09-17T01:07:34.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:34 smithi135 bash[88941]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b 2024-09-17T01:07:35.299 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:34 smithi135 podman[88964]: 2024-09-17 01:07:34.966288056 +0000 UTC m=+0.664196389 container remove 87badd5ae073ea13a7fe54cea20190a5172938479f5fd4367e3fec025cd3bb5b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, io.k8s.display-name=CentOS Stream 8, version=8, CEPH_POINT_RELEASE=-17.2.0, release=754, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, RELEASE=HEAD, ceph=True, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-09-17T01:07:35.300 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-17T01:07:35.300 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 systemd[1]: Stopped Ceph mon.b for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:35.300 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.b.service: Consumed 16.186s CPU time. 2024-09-17T01:07:35.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 systemd[1]: Starting Ceph mon.b for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:35.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 podman[89093]: 2024-09-17 01:07:35.413905521 +0000 UTC m=+0.016112932 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:07:35.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 podman[89093]: 2024-09-17 01:07:35.534067639 +0000 UTC m=+0.136275036 container create 1919d116b948ed243a723ee3f02a8d1c323808b43c39a621b8a2584874d34d2c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:07:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 podman[89093]: 2024-09-17 01:07:35.784249645 +0000 UTC m=+0.386457051 container init 1919d116b948ed243a723ee3f02a8d1c323808b43c39a621b8a2584874d34d2c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=) 2024-09-17T01:07:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 podman[89093]: 2024-09-17 01:07:35.787524881 +0000 UTC m=+0.389732277 container start 1919d116b948ed243a723ee3f02a8d1c323808b43c39a621b8a2584874d34d2c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T01:07:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: pidfile_write: ignore empty --pid-file 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: load: jerasure load: lrc 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Git sha 0 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: DB SUMMARY 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: DB Session ID: QJ3FNR5ODUZKGA5EWVY6 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: MANIFEST file: MANIFEST-000009 size: 2637 Bytes 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000051.sst 2024-09-17T01:07:35.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000049.log size: 397597 ; 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.env: 0x55e2fa9f2940 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.info_log: 0x55e2fcdbf6e0 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:07:35.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.statistics: (nil) 2024-09-17T01:07:35.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.use_fsync: 0 2024-09-17T01:07:35.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:07:35.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:07:35.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:07:35.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.db_log_dir: 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.wal_dir: 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:07:35.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.write_buffer_manager: 0x55e2fcdce8c0 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:07:35.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.unordered_write: 0 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.row_cache: None 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.wal_filter: None 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:07:35.967 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.wal_compression: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:07:35.968 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_open_files: -1 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:07:35.969 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Compression algorithms supported: 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kZSTD supported: 0 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:07:35.970 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.merge_operator: 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_filter: None 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e2fcdbf320) 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:07:35.971 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_type: 0 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_index_type: 0 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_shortening: 1 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: checksum: 4 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: no_block_cache: 0 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache: 0x55e2fcdb31f0 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_options: 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: capacity : 536870912 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_shard_bits : 4 2024-09-17T01:07:35.972 INFO:journalctl@ceph.mon.b.smithi135.stdout: strict_capacity_limit : 0 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_compressed: (nil) 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: persistent_cache: (nil) 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size: 4096 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size_deviation: 10 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_restart_interval: 16 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_block_restart_interval: 1 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: metadata_block_size: 4096 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: partition_filters: 0 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: use_delta_encoding: 1 2024-09-17T01:07:35.973 INFO:journalctl@ceph.mon.b.smithi135.stdout: filter_policy: bloomfilter 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: whole_key_filtering: 1 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: verify_compression: 0 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: format_version: 5 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_index_compression: 1 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_align: 0 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: max_auto_readahead_size: 262144 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: prepopulate_block_cache: 0 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:07:35.974 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression: NoCompression 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.num_levels: 7 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:07:35.975 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:07:35.976 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:07:35.977 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:07:35.978 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:07:35.979 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.ttl: 2592000 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:07:35.980 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:07:35.981 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 51.sst 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 53, last_sequence is 33292, log_number is 49,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 49 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bdcc5afd-1fdd-495a-b129-95cda3eb50af 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535255813882, "job": 1, "event": "recovery_started", "wal_files": [49]} 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #49 mode 2 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535255815528, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 54, "file_size": 246054, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 33297, "largest_seqno": 33509, "table_properties": {"data_size": 244149, "index_size": 547, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 325, "raw_key_size": 3204, "raw_average_key_size": 25, "raw_value_size": 241606, "raw_average_value_size": 1932, "num_data_blocks": 23, "num_entries": 125, "num_filter_entries": 125, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535255, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bdcc5afd-1fdd-495a-b129-95cda3eb50af", "db_session_id": "QJ3FNR5ODUZKGA5EWVY6", "orig_file_number": 54, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535255815626, "job": 1, "event": "recovery_finished"} 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/version_set.cc:5047] Creating manifest 56 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000049.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e2fcde0e00 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: DB pointer 0x55e2fcedc000 2024-09-17T01:07:35.982 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** DB Stats ** 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:07:35.983 INFO:journalctl@ceph.mon.b.smithi135.stdout: L0 1/0 240.29 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 260.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: L6 1/0 11.89 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: Sum 2/0 12.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 260.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 260.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 260.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:07:35.984 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:07:35.985 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:07:35.985 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:07:35.985 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:07:35.985 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative compaction: 0.00 GB write, 61.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:07:35.985 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval compaction: 0.00 GB write, 61.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:07:35.985 INFO:journalctl@ceph.mon.b.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:07:35.990 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache BinnedLRUCache@0x55e2fcdb31f0#2 capacity: 512.00 MB usage: 1.02 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-17T01:07:35.990 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.38 KB,7.15256e-05%) IndexBlock(1,0.64 KB,0.00012219%) Misc(1,0.00 KB,0%) 2024-09-17T01:07:35.990 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: starting mon.b rank 2 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???) e3 preinit fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???).mds e1 new map 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???).mds e1 print_map 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout: e1 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:35.991 INFO:journalctl@ceph.mon.b.smithi135.stdout: legacy client fscid: -1 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout: No filesystems configured 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 ceph-mon[89112]: mon.b@-1(???).paxosservice(auth 1..28) refresh upgraded, format 0 -> 3 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 bash[89093]: 1919d116b948ed243a723ee3f02a8d1c323808b43c39a621b8a2584874d34d2c 2024-09-17T01:07:35.992 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:35 smithi135 systemd[1]: Started Ceph mon.b for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:37.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:07:36] "GET /metrics HTTP/1.1" 200 38268 "" "Prometheus/2.43.0" 2024-09-17T01:07:38.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:38 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:38.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:43.584 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:43 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:43.505Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:46.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:07:45.827+0000 7f82703f1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T01:07:46.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:07:46] "GET /metrics HTTP/1.1" 200 38268 "" "Prometheus/2.43.0" 2024-09-17T01:07:48.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:48.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mon.c calling monitor election 2024-09-17T01:07:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mon.b calling monitor election 2024-09-17T01:07:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mon.c calling monitor election 2024-09-17T01:07:48.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: last_changed 2024-09-17T01:07:42.437264+0000 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: min_mon_release 19 (squid) 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: election_strategy: 1 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: fsmap 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mgrmap e46: x(active, since 89s), standbys: y 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-17T01:07:48.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mon.b (rank 2) addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] is down (out of quorum) 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mon.a calling monitor election 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: monmap epoch 4 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: last_changed 2024-09-17T01:07:42.437264+0000 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: min_mon_release 19 (squid) 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: election_strategy: 1 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:48.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: fsmap 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: mgrmap e46: x(active, since 89s), standbys: y 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: overall HEALTH_OK 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: Reconfiguring daemon mon.a on smithi071 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:48.858 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mon.c calling monitor election 2024-09-17T01:07:48.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mon.b calling monitor election 2024-09-17T01:07:48.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mon.c calling monitor election 2024-09-17T01:07:48.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:48.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: last_changed 2024-09-17T01:07:42.437264+0000 2024-09-17T01:07:48.859 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: min_mon_release 19 (squid) 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: election_strategy: 1 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: fsmap 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mgrmap e46: x(active, since 89s), standbys: y 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mon.b (rank 2) addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] is down (out of quorum) 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mon.a calling monitor election 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:07:48.860 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: monmap epoch 4 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: last_changed 2024-09-17T01:07:42.437264+0000 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: min_mon_release 19 (squid) 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: election_strategy: 1 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: fsmap 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: mgrmap e46: x(active, since 89s), standbys: y 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:07:48.861 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: overall HEALTH_OK 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: Reconfiguring daemon mon.a on smithi071 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mon.c calling monitor election 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mon.b calling monitor election 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mon.c calling monitor election 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:48.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: last_changed 2024-09-17T01:07:42.437264+0000 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: min_mon_release 19 (squid) 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: election_strategy: 1 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: fsmap 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mgrmap e46: x(active, since 89s), standbys: y 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mon.b (rank 2) addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] is down (out of quorum) 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mon.a calling monitor election 2024-09-17T01:07:48.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: monmap epoch 4 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: fsid e9235fcc-748e-11ef-bceb-c7b262605968 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: last_changed 2024-09-17T01:07:42.437264+0000 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: created 2024-09-17T00:51:39.765300+0000 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: min_mon_release 19 (squid) 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: election_strategy: 1 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: 0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: 1: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: fsmap 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: osdmap e113: 8 total, 8 up, 8 in 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: mgrmap e46: x(active, since 89s), standbys: y 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-17T01:07:48.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: overall HEALTH_OK 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: Reconfiguring daemon mon.a on smithi071 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:48.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:49.708 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[96259]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:49.708 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:49.708 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:49.708 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:07:49.708 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:07:49.708 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:49.709 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[105664]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:49.709 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:49.709 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:49.709 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:07:49.709 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:07:49.709 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:49.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:49 smithi135 ceph-mon[89112]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:49.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:49.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:49.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:07:49.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:07:49.829 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: Reconfiguring mgr.y (monmap changed)... 2024-09-17T01:07:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: Reconfiguring daemon mgr.y on smithi071 2024-09-17T01:07:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:50.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: Reconfiguring mgr.y (monmap changed)... 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: Reconfiguring daemon mgr.y on smithi071 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:50.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: Reconfiguring mgr.y (monmap changed)... 2024-09-17T01:07:50.678 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: Reconfiguring daemon mgr.y on smithi071 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:50.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[96259]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:51.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[96259]: Reconfiguring mon.c (monmap changed)... 2024-09-17T01:07:51.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[96259]: Reconfiguring daemon mon.c on smithi071 2024-09-17T01:07:51.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.695 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[105664]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:51.695 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[105664]: Reconfiguring mon.c (monmap changed)... 2024-09-17T01:07:51.695 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[105664]: Reconfiguring daemon mon.c on smithi071 2024-09-17T01:07:51.695 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.695 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.695 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:51 smithi135 ceph-mon[89112]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:51.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:51 smithi135 ceph-mon[89112]: Reconfiguring mon.c (monmap changed)... 2024-09-17T01:07:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:51 smithi135 ceph-mon[89112]: Reconfiguring daemon mon.c on smithi071 2024-09-17T01:07:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:07:53.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.0 on smithi071 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:07:53.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.0 on smithi071 2024-09-17T01:07:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.0 on smithi071 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:53.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:53.506Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:54.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[105664]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.1 on smithi071 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[96259]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:07:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:54 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.1 on smithi071 2024-09-17T01:07:54.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:54.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:54.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:54 smithi135 ceph-mon[89112]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:07:54.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:07:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:54 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.1 on smithi071 2024-09-17T01:07:55.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:55 smithi071 ceph-mon[96259]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:55.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:55 smithi071 ceph-mon[105664]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:55.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:55 smithi135 ceph-mon[89112]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:07:56.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:56.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:56.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[96259]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:07:56.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:07:56.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:56.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.2 on smithi071 2024-09-17T01:07:56.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[96259]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[105664]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:07:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:07:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.2 on smithi071 2024-09-17T01:07:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:56 smithi071 ceph-mon[105664]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:56.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:07:56] "GET /metrics HTTP/1.1" 200 38279 "" "Prometheus/2.43.0" 2024-09-17T01:07:56.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:56.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:56.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-mon[89112]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:07:56.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:07:56.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:56.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.2 on smithi071 2024-09-17T01:07:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:56 smithi135 ceph-mon[89112]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:58.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:07:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:07:58.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:07:59.693 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[105664]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:59.693 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:59.693 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:59.693 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:07:59.693 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:59.693 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[96259]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:59.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:59.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:59.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:07:59.694 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:07:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:59.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:59 smithi135 ceph-mon[89112]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:07:59.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:59.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:07:59.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:07:59.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:07:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:00 smithi135 ceph-mon[89112]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:08:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:00 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.3 on smithi071 2024-09-17T01:08:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:00 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:00 smithi071 ceph-mon[96259]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:08:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:00 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.3 on smithi071 2024-09-17T01:08:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:00 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:00.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:00 smithi071 ceph-mon[105664]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:08:00.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:00 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.3 on smithi071 2024-09-17T01:08:00.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:00 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:01.518 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:08:01.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[96259]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:01.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:01.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:01.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:01.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:01.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[105664]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:01.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:01.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:01.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:01.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:01 smithi135 ceph-mon[89112]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:02.189 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:08:02.189 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 9s ago 15m - - 2024-09-17T01:08:02.190 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 11s ago 15m - - 2024-09-17T01:08:02.190 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (4m) 9s ago 10m 24.9M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:08:02.190 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (4m) 11s ago 10m 51.6M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:08:02.190 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (3m) 9s ago 8m 55.2M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:08:02.190 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (3m) 11s ago 14m 506M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:08:02.190 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (2m) 9s ago 16m 440M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:08:02.191 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (87s) 9s ago 16m 47.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:08:02.191 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (26s) 11s ago 14m 21.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:08:02.191 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (48s) 9s ago 14m 40.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:08:02.191 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (5m) 9s ago 10m 15.3M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:08:02.191 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (4m) 11s ago 10m 16.7M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:08:02.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (14m) 9s ago 14m 58.0M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:08:02.191 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (13m) 9s ago 13m 57.0M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:08:02.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (13m) 9s ago 13m 52.0M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:08:02.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (13m) 9s ago 13m 57.5M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:08:02.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (12m) 11s ago 12m 56.5M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:08:02.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (12m) 11s ago 12m 52.5M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:08:02.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (11m) 11s ago 11m 52.2M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:08:02.192 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (11m) 11s ago 11m 57.1M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:08:02.192 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (3m) 11s ago 10m 62.7M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:08:02.193 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (8m) 9s ago 8m 76.2M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:08:02.193 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (8m) 11s ago 8m 74.6M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:08:02.193 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (8m) 9s ago 8m 74.3M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:08:02.193 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (8m) 11s ago 8m 74.5M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:02.613 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:08:02.614 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:08:02.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:02.614 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:08:02.614 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-09-17T01:08:02.614 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:08:02.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:08:02.614 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:08:02.696 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[105664]: Reconfiguring rgw.foo.smithi071.hdtkfj (monmap changed)... 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[105664]: Reconfiguring daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[105664]: from='client.44172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[96259]: Reconfiguring rgw.foo.smithi071.hdtkfj (monmap changed)... 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[96259]: Reconfiguring daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T01:08:02.697 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[96259]: from='client.44172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:02.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:02.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:02.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:02.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:02 smithi135 ceph-mon[89112]: Reconfiguring rgw.foo.smithi071.hdtkfj (monmap changed)... 2024-09-17T01:08:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:02 smithi135 ceph-mon[89112]: Reconfiguring daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T01:08:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:02 smithi135 ceph-mon[89112]: from='client.44172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:02.950 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:08:02.950 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "5/23 daemons upgraded", 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:08:02.951 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:08:03.353 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:08:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: Reconfiguring rgw.smpl.smithi071.dosgxu (monmap changed)... 2024-09-17T01:08:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: Reconfiguring daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T01:08:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1705819061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3762974537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: Reconfiguring rgw.smpl.smithi071.dosgxu (monmap changed)... 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: Reconfiguring daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1705819061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:03.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3762974537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:03.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:03.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:08:03.506Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:08:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: Reconfiguring rgw.smpl.smithi071.dosgxu (monmap changed)... 2024-09-17T01:08:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: Reconfiguring daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T01:08:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:03.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1705819061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:03.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3762974537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:03.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:04.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:04.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:04.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:04.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: Reconfiguring mon.b (monmap changed)... 2024-09-17T01:08:04.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:08:04.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:08:04.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:04.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:04 smithi135 ceph-mon[89112]: Reconfiguring daemon mon.b on smithi135 2024-09-17T01:08:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: Reconfiguring mon.b (monmap changed)... 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[96259]: Reconfiguring daemon mon.b on smithi135 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:04.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:04.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:04.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: Reconfiguring mon.b (monmap changed)... 2024-09-17T01:08:04.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:08:04.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:08:04.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:04.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:04 smithi071 ceph-mon[105664]: Reconfiguring daemon mon.b on smithi135 2024-09-17T01:08:05.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:05 smithi135 ceph-mon[89112]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:05.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:05.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:05.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:08:05.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:08:05.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[96259]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:08:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:08:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[105664]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:08:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:08:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:06 smithi071 ceph-mon[96259]: Reconfiguring mgr.x (monmap changed)... 2024-09-17T01:08:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:06 smithi071 ceph-mon[96259]: Reconfiguring daemon mgr.x on smithi135 2024-09-17T01:08:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:06 smithi071 ceph-mon[105664]: Reconfiguring mgr.x (monmap changed)... 2024-09-17T01:08:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:06 smithi071 ceph-mon[105664]: Reconfiguring daemon mgr.x on smithi135 2024-09-17T01:08:06.918 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:06 smithi135 ceph-mon[89112]: Reconfiguring mgr.x (monmap changed)... 2024-09-17T01:08:06.918 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:06 smithi135 ceph-mon[89112]: Reconfiguring daemon mgr.x on smithi135 2024-09-17T01:08:06.918 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:08:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:08:06] "GET /metrics HTTP/1.1" 200 38280 "" "Prometheus/2.43.0" 2024-09-17T01:08:07.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:07 smithi135 ceph-mon[89112]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:07.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:07.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:07.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:08:07.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[96259]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:08:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[105664]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:08:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:08.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:08 smithi071 ceph-mon[96259]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:08:08.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:08 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.4 on smithi135 2024-09-17T01:08:08.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:08 smithi071 ceph-mon[105664]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:08:08.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:08 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.4 on smithi135 2024-09-17T01:08:08.755 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:08 smithi135 ceph-mon[89112]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:08:08.755 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:08 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.4 on smithi135 2024-09-17T01:08:08.755 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:08:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:08:08.659Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:08:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:09 smithi135 ceph-mon[89112]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:09 smithi071 ceph-mon[96259]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:09.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:09 smithi071 ceph-mon[105664]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:10 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:08:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:08:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:08:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:11 smithi135 ceph-mon[89112]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:11 smithi135 ceph-mon[89112]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:08:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:11 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.5 on smithi135 2024-09-17T01:08:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[96259]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[96259]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:08:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.5 on smithi135 2024-09-17T01:08:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[105664]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[105664]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:08:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.5 on smithi135 2024-09-17T01:08:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:11.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: Reconfiguring osd.6 (monmap changed)... 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.6 on smithi135 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: Reconfiguring osd.6 (monmap changed)... 2024-09-17T01:08:13.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:08:13.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:13.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.6 on smithi135 2024-09-17T01:08:13.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:13.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: Reconfiguring osd.6 (monmap changed)... 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.6 on smithi135 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:13.793 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:08:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:08:13.504Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:08:14.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:14.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:14.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:14 smithi135 ceph-mon[89112]: Reconfiguring osd.7 (monmap changed)... 2024-09-17T01:08:14.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:08:14.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:14.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:14 smithi135 ceph-mon[89112]: Reconfiguring daemon osd.7 on smithi135 2024-09-17T01:08:14.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:14.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:14.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[105664]: Reconfiguring osd.7 (monmap changed)... 2024-09-17T01:08:14.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:08:14.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:14.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[105664]: Reconfiguring daemon osd.7 on smithi135 2024-09-17T01:08:14.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:14.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:14.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[96259]: Reconfiguring osd.7 (monmap changed)... 2024-09-17T01:08:14.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:08:14.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:14.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:14 smithi071 ceph-mon[96259]: Reconfiguring daemon osd.7 on smithi135 2024-09-17T01:08:15.571 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:15 smithi135 ceph-mon[89112]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:15.571 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:15.571 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:15.572 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:15.572 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[96259]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[105664]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[105664]: Reconfiguring rgw.foo.smithi135.zorred (monmap changed)... 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[105664]: Reconfiguring daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[96259]: Reconfiguring rgw.foo.smithi135.zorred (monmap changed)... 2024-09-17T01:08:16.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[96259]: Reconfiguring daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T01:08:16.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:16.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:16.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:16.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:16 smithi135 ceph-mon[89112]: Reconfiguring rgw.foo.smithi135.zorred (monmap changed)... 2024-09-17T01:08:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:16 smithi135 ceph-mon[89112]: Reconfiguring daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T01:08:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:16.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:08:16.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:16.976 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:08:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:08:16] "GET /metrics HTTP/1.1" 200 38280 "" "Prometheus/2.43.0" 2024-09-17T01:08:17.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:17 smithi071 ceph-mon[96259]: Reconfiguring rgw.smpl.smithi135.zqqxdl (monmap changed)... 2024-09-17T01:08:17.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:17 smithi071 ceph-mon[96259]: Reconfiguring daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T01:08:17.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:17 smithi071 ceph-mon[96259]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:17.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:17 smithi071 ceph-mon[105664]: Reconfiguring rgw.smpl.smithi135.zqqxdl (monmap changed)... 2024-09-17T01:08:17.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:17 smithi071 ceph-mon[105664]: Reconfiguring daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T01:08:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:17 smithi071 ceph-mon[105664]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:17.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:17 smithi135 ceph-mon[89112]: Reconfiguring rgw.smpl.smithi135.zqqxdl (monmap changed)... 2024-09-17T01:08:17.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:17 smithi135 ceph-mon[89112]: Reconfiguring daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T01:08:17.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:17 smithi135 ceph-mon[89112]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:18.960 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:08:18.658Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=osd name=CephOSDFlapping index=13 msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on (ceph_daemon) group_left (hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"172.21.15.135:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", cluster_addr=\"172.21.15.71\", device_class=\"ssd\", hostname=\"smithi071\", instance=\"ceph_cluster\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.71\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:08:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: Upgrade: Setting container_image for all mon 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: Upgrade: Setting container_image for all crash 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: Upgrade: osd.0 is safe to restart 2024-09-17T01:08:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:19.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: Upgrade: Setting container_image for all mon 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: Upgrade: Setting container_image for all crash 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: Upgrade: osd.0 is safe to restart 2024-09-17T01:08:19.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: Upgrade: Setting container_image for all mon 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-17T01:08:19.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: Upgrade: Setting container_image for all crash 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: Upgrade: osd.0 is safe to restart 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:08:19.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:20.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[96259]: Upgrade: Updating osd.0 2024-09-17T01:08:20.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:20.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:08:20.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[96259]: Deploying daemon osd.0 on smithi071 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[105664]: Upgrade: Updating osd.0 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[105664]: Deploying daemon osd.0 on smithi071 2024-09-17T01:08:20.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:20 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:20 smithi135 ceph-mon[89112]: Upgrade: Updating osd.0 2024-09-17T01:08:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:20.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:08:20.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:20.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:20 smithi135 ceph-mon[89112]: Deploying daemon osd.0 on smithi071 2024-09-17T01:08:20.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:20 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:21 smithi071 ceph-mon[96259]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:21.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:21 smithi071 ceph-mon[105664]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:21 smithi135 ceph-mon[89112]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:22.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:22 smithi071 systemd[1]: Stopping Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:23.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:22 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[31939]: 2024-09-17T01:08:22.753+0000 7fdc0df4e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:08:23.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:22 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[31939]: 2024-09-17T01:08:22.753+0000 7fdc0df4e700 -1 osd.0 113 *** Got signal Terminated *** 2024-09-17T01:08:23.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:22 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[31939]: 2024-09-17T01:08:22.753+0000 7fdc0df4e700 -1 osd.0 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:08:23.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:23 smithi135 ceph-mon[89112]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:08:23.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:23 smithi135 ceph-mon[89112]: osd.0 marked itself down and dead 2024-09-17T01:08:23.710 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:08:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:08:23.506Z caller=manager.go:640 level=warn component="rule manager" file=/etc/prometheus/alerting/ceph_alerts.yml group=nodes name=CephNodeDiskspaceWarning index=4 msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on (instance) group_left (nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi071\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"e9235fcc-748e-11ef-bceb-c7b262605968\", domainname=\"(none)\", instance=\"smithi071\", job=\"node\", machine=\"x86_64\", nodename=\"smithi071\", release=\"5.14.0-508.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-09-17T01:08:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:23 smithi071 ceph-mon[96259]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:08:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:23 smithi071 ceph-mon[96259]: osd.0 marked itself down and dead 2024-09-17T01:08:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:23 smithi071 ceph-mon[105664]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:08:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:23 smithi071 ceph-mon[105664]: osd.0 marked itself down and dead 2024-09-17T01:08:24.309 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:23 smithi071 podman[114190]: 2024-09-17 01:08:23.959855029 +0000 UTC m=+1.357371428 container died 2ed5aa17a4f716a3fb732b59791049de8d3dee156849f175dc6da1605b53651f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, architecture=x86_64, version=8, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, release=754, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., distribution-scope=public, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , io.openshift.expose-services=, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, ceph=True, io.openshift.tags=base centos centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-09-17T01:08:24.627 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:24 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:24.628 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:24 smithi071 ceph-mon[96259]: osdmap e114: 8 total, 7 up, 8 in 2024-09-17T01:08:24.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:24 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:24.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:24 smithi071 ceph-mon[105664]: osdmap e114: 8 total, 7 up, 8 in 2024-09-17T01:08:24.628 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:24 smithi071 podman[114190]: 2024-09-17 01:08:24.311937555 +0000 UTC m=+1.709453945 container cleanup 2ed5aa17a4f716a3fb732b59791049de8d3dee156849f175dc6da1605b53651f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, RELEASE=HEAD, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, architecture=x86_64, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, ceph=True) 2024-09-17T01:08:24.629 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:24 smithi071 bash[114190]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:08:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:24 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:24 smithi135 ceph-mon[89112]: osdmap e114: 8 total, 7 up, 8 in 2024-09-17T01:08:24.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:24 smithi071 podman[114205]: 2024-09-17 01:08:24.630306842 +0000 UTC m=+0.666161240 container remove 2ed5aa17a4f716a3fb732b59791049de8d3dee156849f175dc6da1605b53651f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, ceph=True, build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, distribution-scope=public, GIT_BRANCH=HEAD, release=754, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-17T01:08:25.277 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:24 smithi071 podman[114294]: 2024-09-17 01:08:24.887125854 +0000 UTC m=+0.015873643 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:08:25.277 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:25 smithi071 podman[114294]: 2024-09-17 01:08:25.006284981 +0000 UTC m=+0.135032760 container create 95daf2a3a4d02822f098fa58d2b37806e631256c79cda51c428045454c69a5d0 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T01:08:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:25 smithi071 ceph-mon[96259]: pgmap v67: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:25 smithi071 ceph-mon[96259]: Health check failed: Reduced data availability: 14 pgs inactive, 57 pgs peering (PG_AVAILABILITY) 2024-09-17T01:08:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:25 smithi071 ceph-mon[96259]: osdmap e115: 8 total, 7 up, 8 in 2024-09-17T01:08:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:25 smithi071 ceph-mon[105664]: pgmap v67: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:25.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:25 smithi071 ceph-mon[105664]: Health check failed: Reduced data availability: 14 pgs inactive, 57 pgs peering (PG_AVAILABILITY) 2024-09-17T01:08:25.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:25 smithi071 ceph-mon[105664]: osdmap e115: 8 total, 7 up, 8 in 2024-09-17T01:08:25.648 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:25 smithi071 podman[114294]: 2024-09-17 01:08:25.280055941 +0000 UTC m=+0.408803725 container init 95daf2a3a4d02822f098fa58d2b37806e631256c79cda51c428045454c69a5d0 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T01:08:25.648 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:25 smithi071 podman[114294]: 2024-09-17 01:08:25.283721916 +0000 UTC m=+0.412469697 container start 95daf2a3a4d02822f098fa58d2b37806e631256c79cda51c428045454c69a5d0 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD) 2024-09-17T01:08:25.648 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:25 smithi071 podman[114294]: 2024-09-17 01:08:25.425873062 +0000 UTC m=+0.554620857 container attach 95daf2a3a4d02822f098fa58d2b37806e631256c79cda51c428045454c69a5d0 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T01:08:25.649 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:25 smithi071 podman[114294]: 2024-09-17 01:08:25.474992433 +0000 UTC m=+0.603740224 container died 95daf2a3a4d02822f098fa58d2b37806e631256c79cda51c428045454c69a5d0 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T01:08:25.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:25 smithi135 ceph-mon[89112]: pgmap v67: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:25.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:25 smithi135 ceph-mon[89112]: Health check failed: Reduced data availability: 14 pgs inactive, 57 pgs peering (PG_AVAILABILITY) 2024-09-17T01:08:25.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:25 smithi135 ceph-mon[89112]: osdmap e115: 8 total, 7 up, 8 in 2024-09-17T01:08:26.589 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 podman[114317]: 2024-09-17 01:08:26.154420074 +0000 UTC m=+0.670750653 container remove 95daf2a3a4d02822f098fa58d2b37806e631256c79cda51c428045454c69a5d0 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:08:26.589 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T01:08:26.589 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 systemd[1]: Stopped Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:08:26.590 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service: Consumed 8.163s CPU time. 2024-09-17T01:08:26.590 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 systemd[1]: Starting Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:26.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 podman[114416]: 2024-09-17 01:08:26.49463321 +0000 UTC m=+0.015770654 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:08:26.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 podman[114416]: 2024-09-17 01:08:26.597511352 +0000 UTC m=+0.118648827 container create da3225630209ea7dfcfcc963157523ae1588d27d991f4febe4d40569a07b3da8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97) 2024-09-17T01:08:26.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 podman[114416]: 2024-09-17 01:08:26.833774737 +0000 UTC m=+0.354912173 container init da3225630209ea7dfcfcc963157523ae1588d27d991f4febe4d40569a07b3da8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T01:08:26.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 podman[114416]: 2024-09-17 01:08:26.83716972 +0000 UTC m=+0.358307152 container start da3225630209ea7dfcfcc963157523ae1588d27d991f4febe4d40569a07b3da8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_CLEAN=True) 2024-09-17T01:08:26.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:08:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:08:26] "GET /metrics HTTP/1.1" 200 38282 "" "Prometheus/2.43.0" 2024-09-17T01:08:27.396 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 podman[114416]: 2024-09-17 01:08:26.916900082 +0000 UTC m=+0.438037512 container attach da3225630209ea7dfcfcc963157523ae1588d27d991f4febe4d40569a07b3da8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:08:27.396 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.396 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 bash[114416]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.396 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.396 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:26 smithi071 bash[114416]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.566 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:27 smithi135 ceph-mon[89112]: pgmap v69: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:27 smithi071 ceph-mon[96259]: pgmap v69: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:27 smithi071 ceph-mon[105664]: pgmap v69: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:28.613 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:28.613 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 bash[114416]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:28.614 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:28.614 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 bash[114416]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:28.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:28.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 bash[114416]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:28.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 bash[114416]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 bash[114416]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 bash[114416]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[114431]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 bash[114416]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:08:28.897 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:28 smithi071 podman[114416]: 2024-09-17 01:08:28.668441713 +0000 UTC m=+2.189579153 container died da3225630209ea7dfcfcc963157523ae1588d27d991f4febe4d40569a07b3da8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T01:08:29.590 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:29 smithi071 ceph-mon[105664]: pgmap v70: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:29.591 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:29 smithi071 ceph-mon[96259]: pgmap v70: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:29.591 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 podman[114618]: 2024-09-17 01:08:29.262126095 +0000 UTC m=+0.587912977 container remove da3225630209ea7dfcfcc963157523ae1588d27d991f4febe4d40569a07b3da8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:08:29.591 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 podman[114745]: 2024-09-17 01:08:29.373587931 +0000 UTC m=+0.019290792 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:08:29.591 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 podman[114745]: 2024-09-17 01:08:29.47994236 +0000 UTC m=+0.125645253 container create f661f7c4a1328a358e4491d13553d6751a5184624ecff0c2b754bf7d7936b638 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:08:29.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:29 smithi135 ceph-mon[89112]: pgmap v70: 161 pgs: 58 peering, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:08:29.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 podman[114745]: 2024-09-17 01:08:29.716010796 +0000 UTC m=+0.361713648 container init f661f7c4a1328a358e4491d13553d6751a5184624ecff0c2b754bf7d7936b638 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:08:29.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 podman[114745]: 2024-09-17 01:08:29.719483204 +0000 UTC m=+0.365186056 container start f661f7c4a1328a358e4491d13553d6751a5184624ecff0c2b754bf7d7936b638 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T01:08:29.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 ceph-osd[114780]: -- 172.21.15.71:0/1001218158 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556209309a40 con 0x55620a0d0000 2024-09-17T01:08:29.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 bash[114745]: f661f7c4a1328a358e4491d13553d6751a5184624ecff0c2b754bf7d7936b638 2024-09-17T01:08:29.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:29 smithi071 systemd[1]: Started Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:08:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.801 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:30.801 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.801 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.801 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.801 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.802 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:30.803 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.804 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:30.805 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: pgmap v71: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 75/726 objects degraded (10.331%) 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 14 pgs inactive, 57 pgs peering) 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[114776]: 2024-09-17T01:08:31.623+0000 7f5c626d6640 -1 Falling back to public interface 2024-09-17T01:08:31.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: pgmap v71: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 75/726 objects degraded (10.331%) 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: pgmap v71: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 75/726 objects degraded (10.331%) 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 14 pgs inactive, 57 pgs peering) 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 14 pgs inactive, 57 pgs peering) 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:31.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:32.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: pgmap v72: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 75/726 objects degraded (10.331%) 2024-09-17T01:08:33.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.614 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: pgmap v72: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 75/726 objects degraded (10.331%) 2024-09-17T01:08:33.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:33.620 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.621 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: pgmap v72: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 75/726 objects degraded (10.331%) 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:33.744 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 1s ago 15m - - 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 3s ago 15m - - 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (5m) 1s ago 10m 24.9M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (4m) 3s ago 10m 54.4M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (3m) 1s ago 9m 55.3M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (4m) 3s ago 15m 509M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:08:34.421 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (2m) 1s ago 16m 440M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (119s) 1s ago 16m 49.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (59s) 3s ago 15m 33.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (80s) 1s ago 15m 43.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (5m) 1s ago 11m 15.4M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (4m) 3s ago 11m 16.1M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (14m) 1s ago 14m 58.0M 4096M 17.2.0 e1d6a67b021e 2ed5aa17a4f7 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (14m) 1s ago 14m 56.9M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (14m) 1s ago 14m 52.1M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (13m) 1s ago 13m 57.5M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (13m) 3s ago 13m 57.2M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (12m) 3s ago 12m 53.2M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (12m) 3s ago 12m 52.7M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:08:34.422 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (12m) 3s ago 12m 58.0M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:08:34.423 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (3m) 3s ago 11m 64.8M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:08:34.423 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (9m) 1s ago 9m 76.3M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:08:34.423 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (9m) 3s ago 9m 74.7M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:08:34.423 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (9m) 1s ago 9m 74.3M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:08:34.423 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (9m) 3s ago 9m 74.6M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:08:34.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:34.600 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[105664]: Upgrade: osd.0 is safe to restart 2024-09-17T01:08:34.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:34.601 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:34 smithi071 ceph-mon[96259]: Upgrade: osd.0 is safe to restart 2024-09-17T01:08:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:34 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:08:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:34 smithi135 ceph-mon[89112]: Upgrade: osd.0 is safe to restart 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:08:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:08:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:08:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:08:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-09-17T01:08:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:08:34.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:08:34.846 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:08:35.198 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "5/23 daemons upgraded", 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:08:35.199 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:08:35.423 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[114776]: 2024-09-17T01:08:35.168+0000 7f5c626d6640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-17T01:08:35.423 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[114776]: 2024-09-17T01:08:35.192+0000 7f5c626d6640 -1 osd.0 113 log_to_monitors true 2024-09-17T01:08:35.640 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded 2024-09-17T01:08:35.640 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:08:35.641 INFO:teuthology.orchestra.run.smithi071.stdout: osd.0 (root=default,host=smithi071) is down 2024-09-17T01:08:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded 2024-09-17T01:08:35.641 INFO:teuthology.orchestra.run.smithi071.stdout: pg 1.0 is active+undersized+degraded, acting [7,6] 2024-09-17T01:08:35.641 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.0 is active+undersized+degraded, acting [7,1] 2024-09-17T01:08:35.641 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.f is active+undersized+degraded, acting [4,7] 2024-09-17T01:08:35.641 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1 is active+undersized+degraded, acting [4,3] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.3 is active+undersized+degraded, acting [4,6] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.6 is active+undersized+degraded, acting [1,4] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.7 is active+undersized+degraded, acting [3,7] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.b is active+undersized+degraded, acting [3,4] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.f is active+undersized+degraded, acting [7,4] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.10 is active+undersized+degraded, acting [6,5] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.12 is active+undersized+degraded, acting [7,3] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.17 is active+undersized+degraded, acting [5,3] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.18 is active+undersized+degraded, acting [3,1] 2024-09-17T01:08:35.642 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1b is active+undersized+degraded, acting [4,7] 2024-09-17T01:08:35.643 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1f is active+undersized+degraded, acting [5,2] 2024-09-17T01:08:35.643 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.0 is active+undersized+degraded, acting [3,7] 2024-09-17T01:08:35.643 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.3 is active+undersized+degraded, acting [5,7] 2024-09-17T01:08:35.643 INFO:teuthology.orchestra.run.smithi071.stdout: pg 5.8 is active+undersized+degraded, acting [2,1] 2024-09-17T01:08:35.643 INFO:teuthology.orchestra.run.smithi071.stdout: pg 5.1d is active+undersized+degraded, acting [1,4] 2024-09-17T01:08:35.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[105664]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[105664]: from='client.44217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[105664]: pgmap v73: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:35.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[105664]: from='client.64189 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3885456069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:35.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[105664]: from='osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:35.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[105664]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:35.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[96259]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[96259]: from='client.44217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[96259]: pgmap v73: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:35.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[96259]: from='client.64189 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3885456069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:35.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[96259]: from='osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:35.709 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-mon[96259]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:35 smithi135 ceph-mon[89112]: from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:35 smithi135 ceph-mon[89112]: from='client.44217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:35 smithi135 ceph-mon[89112]: pgmap v73: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:35 smithi135 ceph-mon[89112]: from='client.64189 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:35 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3885456069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:35 smithi135 ceph-mon[89112]: from='osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:35 smithi135 ceph-mon[89112]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:36.089 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:35 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[114776]: 2024-09-17T01:08:35.917+0000 7f5c56479640 -1 osd.0 113 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:08:36.761 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='client.64201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:36.761 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:08:36.761 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: osdmap e116: 8 total, 7 up, 8 in 2024-09-17T01:08:36.761 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: Upgrade: Updating osd.0 2024-09-17T01:08:36.761 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: Deploying daemon osd.0 on smithi071 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3406803110' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[105664]: from='osd.0 ' entity='osd.0' 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='client.64201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: osdmap e116: 8 total, 7 up, 8 in 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: Upgrade: Updating osd.0 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:08:36.762 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:08:36.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:36.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: Deploying daemon osd.0 on smithi071 2024-09-17T01:08:36.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3406803110' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:36.763 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:36 smithi071 ceph-mon[96259]: from='osd.0 ' entity='osd.0' 2024-09-17T01:08:36.772 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='client.64201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:36.772 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:08:36.772 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: osdmap e116: 8 total, 7 up, 8 in 2024-09-17T01:08:36.772 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: Upgrade: Updating osd.0 2024-09-17T01:08:36.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:08:36.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:08:36.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:08:36.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:36.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: Deploying daemon osd.0 on smithi071 2024-09-17T01:08:36.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3406803110' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:36.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-mon[89112]: from='osd.0 ' entity='osd.0' 2024-09-17T01:08:37.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:08:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:08:36] "GET /metrics HTTP/1.1" 200 38423 "" "Prometheus/2.43.0" 2024-09-17T01:08:37.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[105664]: pgmap v75: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:37.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:08:37.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[105664]: osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371] boot 2024-09-17T01:08:37.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[105664]: osdmap e117: 8 total, 8 up, 8 in 2024-09-17T01:08:37.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:08:37.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[96259]: pgmap v75: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:37.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:08:37.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[96259]: osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371] boot 2024-09-17T01:08:37.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[96259]: osdmap e117: 8 total, 8 up, 8 in 2024-09-17T01:08:37.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:08:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:37 smithi135 ceph-mon[89112]: pgmap v75: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:37 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:08:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:37 smithi135 ceph-mon[89112]: osd.0 [v2:172.21.15.71:6800/3428010371,v1:172.21.15.71:6801/3428010371] boot 2024-09-17T01:08:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:37 smithi135 ceph-mon[89112]: osdmap e117: 8 total, 8 up, 8 in 2024-09-17T01:08:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:08:39.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:38 smithi071 ceph-mon[105664]: osdmap e118: 8 total, 8 up, 8 in 2024-09-17T01:08:39.053 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:38 smithi071 ceph-mon[105664]: pgmap v78: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:39.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:38 smithi071 ceph-mon[96259]: osdmap e118: 8 total, 8 up, 8 in 2024-09-17T01:08:39.053 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:38 smithi071 ceph-mon[96259]: pgmap v78: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:38 smithi135 ceph-mon[89112]: osdmap e118: 8 total, 8 up, 8 in 2024-09-17T01:08:39.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:38 smithi135 ceph-mon[89112]: pgmap v78: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:40.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:39 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:40.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:39 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:40.211 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:39 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:40.831 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:40 smithi071 systemd[1]: Stopping Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:41.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:40 smithi071 ceph-mon[96259]: pgmap v79: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 32/726 objects degraded (4.408%) 2024-09-17T01:08:41.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:40 smithi071 ceph-mon[105664]: pgmap v79: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 32/726 objects degraded (4.408%) 2024-09-17T01:08:41.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:40 smithi135 ceph-mon[89112]: pgmap v79: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 32/726 objects degraded (4.408%) 2024-09-17T01:08:42.185 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:41 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 32/726 objects degraded (4.408%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:42.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:41 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 32/726 objects degraded (4.408%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:42.185 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[114776]: 2024-09-17T01:08:41.983+0000 7f5c5f66e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:08:42.185 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[114776]: 2024-09-17T01:08:41.983+0000 7f5c5f66e640 -1 osd.0 118 *** Got signal Terminated *** 2024-09-17T01:08:42.185 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:41 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[114776]: 2024-09-17T01:08:41.983+0000 7f5c5f66e640 -1 osd.0 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:08:42.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:41 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 32/726 objects degraded (4.408%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:42 smithi135 ceph-mon[89112]: osd.0 marked itself down and dead 2024-09-17T01:08:43.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:42 smithi135 ceph-mon[89112]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-09-17T01:08:43.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[96259]: osd.0 marked itself down and dead 2024-09-17T01:08:43.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[96259]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-09-17T01:08:43.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:43.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[105664]: osd.0 marked itself down and dead 2024-09-17T01:08:43.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:42 smithi071 ceph-mon[105664]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-09-17T01:08:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:43 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/726 objects degraded (4.408%), 7 pgs degraded) 2024-09-17T01:08:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:43 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:08:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:43 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:44.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:43 smithi135 ceph-mon[89112]: osdmap e119: 8 total, 7 up, 8 in 2024-09-17T01:08:44.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/726 objects degraded (4.408%), 7 pgs degraded) 2024-09-17T01:08:44.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:08:44.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:44.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[105664]: osdmap e119: 8 total, 7 up, 8 in 2024-09-17T01:08:44.373 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:44 smithi071 podman[117313]: 2024-09-17 01:08:44.083369611 +0000 UTC m=+2.233278692 container died f661f7c4a1328a358e4491d13553d6751a5184624ecff0c2b754bf7d7936b638 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T01:08:44.374 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/726 objects degraded (4.408%), 7 pgs degraded) 2024-09-17T01:08:44.374 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:08:44.374 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:44.374 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:43 smithi071 ceph-mon[96259]: osdmap e119: 8 total, 7 up, 8 in 2024-09-17T01:08:44.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:44 smithi071 podman[117313]: 2024-09-17 01:08:44.591664522 +0000 UTC m=+2.741573635 container cleanup f661f7c4a1328a358e4491d13553d6751a5184624ecff0c2b754bf7d7936b638 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:08:44.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:44 smithi071 bash[117313]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:08:45.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:44 smithi071 ceph-mon[105664]: osdmap e120: 8 total, 7 up, 8 in 2024-09-17T01:08:45.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:44 smithi071 ceph-mon[105664]: pgmap v83: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:45.134 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:44 smithi071 ceph-mon[96259]: osdmap e120: 8 total, 7 up, 8 in 2024-09-17T01:08:45.135 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:44 smithi071 ceph-mon[96259]: pgmap v83: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:45.135 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:44 smithi071 podman[117634]: 2024-09-17 01:08:44.80150736 +0000 UTC m=+1.350024052 container remove f661f7c4a1328a358e4491d13553d6751a5184624ecff0c2b754bf7d7936b638 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T01:08:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:44 smithi135 ceph-mon[89112]: osdmap e120: 8 total, 7 up, 8 in 2024-09-17T01:08:45.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:44 smithi135 ceph-mon[89112]: pgmap v83: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:46.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:45 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:46.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:45 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:46.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:45 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:46.685 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:46 smithi071 podman[117941]: 2024-09-17 01:08:46.321334399 +0000 UTC m=+0.020951758 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:08:46.685 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:46 smithi071 podman[117941]: 2024-09-17 01:08:46.434592415 +0000 UTC m=+0.134209737 container create 98889ecf71e4975aa8db5a01d9aae935ec93529370e0897055b66f9bedbdeadc (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:08:46.950 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:46 smithi071 podman[117941]: 2024-09-17 01:08:46.687276024 +0000 UTC m=+0.386893355 container init 98889ecf71e4975aa8db5a01d9aae935ec93529370e0897055b66f9bedbdeadc (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:08:46.951 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:46 smithi071 podman[117941]: 2024-09-17 01:08:46.690831337 +0000 UTC m=+0.390448670 container start 98889ecf71e4975aa8db5a01d9aae935ec93529370e0897055b66f9bedbdeadc (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:08:46.951 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:46 smithi071 podman[117941]: 2024-09-17 01:08:46.77877763 +0000 UTC m=+0.478394960 container attach 98889ecf71e4975aa8db5a01d9aae935ec93529370e0897055b66f9bedbdeadc (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_CLEAN=True) 2024-09-17T01:08:46.951 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:08:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:08:46] "GET /metrics HTTP/1.1" 200 38423 "" "Prometheus/2.43.0" 2024-09-17T01:08:47.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:46 smithi135 ceph-mon[89112]: pgmap v84: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:47.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:46 smithi071 ceph-mon[105664]: pgmap v84: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:47.237 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:46 smithi071 ceph-mon[96259]: pgmap v84: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:48.396 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:48 smithi071 podman[117941]: 2024-09-17 01:08:48.116892543 +0000 UTC m=+1.816509875 container died 98889ecf71e4975aa8db5a01d9aae935ec93529370e0897055b66f9bedbdeadc (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:08:49.128 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:48 smithi071 podman[118010]: 2024-09-17 01:08:48.765086426 +0000 UTC m=+1.872657780 container remove 98889ecf71e4975aa8db5a01d9aae935ec93529370e0897055b66f9bedbdeadc (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97) 2024-09-17T01:08:49.128 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:48 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T01:08:49.129 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:48 smithi071 systemd[1]: Stopped Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:08:49.129 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:48 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service: Consumed 2.001s CPU time. 2024-09-17T01:08:49.129 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:48 smithi071 systemd[1]: Starting Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:49.190 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.190 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.190 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:49 smithi135 ceph-mon[89112]: pgmap v85: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 660 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:49.190 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.191 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:49.191 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.393 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[96259]: pgmap v85: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 660 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[105664]: pgmap v85: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 660 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:49.394 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:49.395 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 podman[118179]: 2024-09-17 01:08:49.106248562 +0000 UTC m=+0.015697264 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:08:49.395 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 podman[118179]: 2024-09-17 01:08:49.233428134 +0000 UTC m=+0.142876833 container create ef1592e923de542ea54259281efb6681ea8eb349f0e496368e54419e9e496b64 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97) 2024-09-17T01:08:49.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 podman[118179]: 2024-09-17 01:08:49.511167839 +0000 UTC m=+0.420616548 container init ef1592e923de542ea54259281efb6681ea8eb349f0e496368e54419e9e496b64 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:08:49.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 podman[118179]: 2024-09-17 01:08:49.514398933 +0000 UTC m=+0.423847631 container start ef1592e923de542ea54259281efb6681ea8eb349f0e496368e54419e9e496b64 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, RELEASE=squid-c2ddf97, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:08:49.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 podman[118179]: 2024-09-17 01:08:49.594351503 +0000 UTC m=+0.503800202 container attach ef1592e923de542ea54259281efb6681ea8eb349f0e496368e54419e9e496b64 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97) 2024-09-17T01:08:49.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:49.647 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 bash[118179]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:50.129 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:50.130 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:49 smithi071 bash[118179]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:50.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:50 smithi071 ceph-mon[105664]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:08:50.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:50 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:50.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:50 smithi071 ceph-mon[96259]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:08:50.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:50 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:50.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:50 smithi135 ceph-mon[89112]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:08:50.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:50 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:08:51.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[96259]: pgmap v86: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:51.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.311 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[105664]: pgmap v86: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:51.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.312 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.312 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:51.312 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 bash[118179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:51.312 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:51.312 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 bash[118179]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:51 smithi135 ceph-mon[89112]: pgmap v86: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:51.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:51.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 bash[118179]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:51.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:08:51.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 bash[118179]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:08:51.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:08:51.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 bash[118179]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:08:51.647 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:51.647 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 bash[118179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:08:51.647 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate[118193]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:08:51.647 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 bash[118179]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:08:51.647 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:51 smithi071 podman[118179]: 2024-09-17 01:08:51.352948933 +0000 UTC m=+2.262397641 container died ef1592e923de542ea54259281efb6681ea8eb349f0e496368e54419e9e496b64 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-17T01:08:52.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:52 smithi071 ceph-mon[96259]: pgmap v87: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:52.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:52 smithi071 ceph-mon[96259]: pgmap v88: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:52.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:52 smithi071 ceph-mon[105664]: pgmap v87: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:52.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:52 smithi071 ceph-mon[105664]: pgmap v88: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:52.397 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 podman[118338]: 2024-09-17 01:08:52.249047042 +0000 UTC m=+0.886391302 container remove ef1592e923de542ea54259281efb6681ea8eb349f0e496368e54419e9e496b64 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T01:08:52.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:52 smithi135 ceph-mon[89112]: pgmap v87: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:52.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:52 smithi135 ceph-mon[89112]: pgmap v88: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:52.733 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 podman[118399]: 2024-09-17 01:08:52.359386272 +0000 UTC m=+0.016238621 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:08:52.733 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 podman[118399]: 2024-09-17 01:08:52.500370222 +0000 UTC m=+0.157222619 container create d64a79e0beded5d8013107f0aeeab92600b43eec83cb84aac5bacf9b5086437c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:08:53.061 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 podman[118399]: 2024-09-17 01:08:52.735918891 +0000 UTC m=+0.392771238 container init d64a79e0beded5d8013107f0aeeab92600b43eec83cb84aac5bacf9b5086437c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:08:53.062 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 podman[118399]: 2024-09-17 01:08:52.739169771 +0000 UTC m=+0.396022110 container start d64a79e0beded5d8013107f0aeeab92600b43eec83cb84aac5bacf9b5086437c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:08:53.062 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 ceph-osd[118418]: -- 172.21.15.71:0/591968542 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f959beba40 con 0x55f95a9b2000 2024-09-17T01:08:53.062 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 bash[118399]: d64a79e0beded5d8013107f0aeeab92600b43eec83cb84aac5bacf9b5086437c 2024-09-17T01:08:53.062 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:52 smithi071 systemd[1]: Started Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:08:54.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: pgmap v89: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: pgmap v89: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: pgmap v89: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:54.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:54.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:54.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:54.646 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[118414]: 2024-09-17T01:08:54.383+0000 7f265d6c1640 -1 Falling back to public interface 2024-09-17T01:08:55.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.136 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.137 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.138 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.139 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.140 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.141 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.142 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.143 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:55.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:55.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.178 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.178 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.178 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.178 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: pgmap v90: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:56.178 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.178 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.179 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.180 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: pgmap v90: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.181 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.182 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.184 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.185 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.186 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.186 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.186 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.186 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.186 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: pgmap v90: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:56.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:08:56] "GET /metrics HTTP/1.1" 200 38441 "" "Prometheus/2.43.0" 2024-09-17T01:08:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.237 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:57.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[118414]: 2024-09-17T01:08:57.943+0000 7f265d6c1640 -1 osd.0 118 log_to_monitors true 2024-09-17T01:08:58.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: pgmap v91: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: pgmap v91: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:58.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: pgmap v91: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:08:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:58.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:58.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:58.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:58.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:58.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[118414]: 2024-09-17T01:08:58.933+0000 7f2651464640 -1 osd.0 118 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:08:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:08:59.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:59.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: pgmap v92: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 584 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: osdmap e121: 8 total, 7 up, 8 in 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: pgmap v92: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 584 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:00.090 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: osdmap e121: 8 total, 7 up, 8 in 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.091 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:08:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: pgmap v92: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 584 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: osdmap e121: 8 total, 7 up, 8 in 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:00.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:08:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:01.126 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186] boot 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: osdmap e122: 8 total, 8 up, 8 in 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.127 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.128 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186] boot 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: osdmap e122: 8 total, 8 up, 8 in 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.129 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.130 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.131 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.132 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[96259]: osdmap e123: 8 total, 8 up, 8 in 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.133 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.134 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.135 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:00 smithi071 ceph-mon[105664]: osdmap e123: 8 total, 8 up, 8 in 2024-09-17T01:09:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: osd.0 [v2:172.21.15.71:6800/181172186,v1:172.21.15.71:6801/181172186] boot 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: osdmap e122: 8 total, 8 up, 8 in 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:01.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:01.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:01.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:01.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:01.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:00 smithi135 ceph-mon[89112]: osdmap e123: 8 total, 8 up, 8 in 2024-09-17T01:09:02.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.069 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: pgmap v95: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: pgmap v95: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.073 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.076 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.077 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: pgmap v95: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:02.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.199 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.200 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.201 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:03.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: pgmap v97: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.203 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.204 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.205 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: pgmap v97: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.206 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.207 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: pgmap v97: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 75/726 objects degraded (10.331%) 2024-09-17T01:09:04.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:04.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:04.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:04.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:04.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:04.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.216 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.217 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T01:09:05.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.962 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.963 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.964 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.965 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.966 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.969 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded) 2024-09-17T01:09:05.970 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:09:05.970 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.970 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.970 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.970 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.970 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.970 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.971 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.972 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.973 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded) 2024-09-17T01:09:05.974 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:09:05.975 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:05.975 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:05.975 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:05.975 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:05.975 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.027 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:09:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 75/726 objects degraded (10.331%), 20 pgs degraded) 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:06.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:06.734 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:09:06.734 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 18s ago 16m - - 2024-09-17T01:09:06.734 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 15s ago 16m - - 2024-09-17T01:09:06.734 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (5m) 18s ago 11m 24.9M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:09:06.734 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (5m) 15s ago 11m 54.7M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:09:06.734 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (4m) 18s ago 9m 55.4M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (4m) 15s ago 15m 511M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (3m) 18s ago 17m 440M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (2m) 18s ago 17m 51.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (91s) 15s ago 15m 35.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (113s) 18s ago 16m 45.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (6m) 18s ago 11m 15.3M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (5m) 15s ago 11m 16.1M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 starting - - - 4096M 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (14m) 18s ago 14m 58.3M 4096M 17.2.0 e1d6a67b021e 530dc8f143ca 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (14m) 18s ago 14m 53.1M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (14m) 18s ago 14m 58.9M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (13m) 15s ago 13m 58.5M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (13m) 15s ago 13m 54.6M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (13m) 15s ago 13m 53.7M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (12m) 15s ago 12m 58.3M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:09:06.735 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (4m) 15s ago 11m 62.6M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:09:06.736 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (10m) 18s ago 10m 76.4M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:09:06.736 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (10m) 15s ago 9m 74.8M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:09:06.736 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (9m) 18s ago 9m 74.5M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:09:06.736 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (9m) 15s ago 9m 74.7M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:09:06.943 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:09:06] "GET /metrics HTTP/1.1" 200 38221 "" "Prometheus/2.43.0" 2024-09-17T01:09:07.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='client.44256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='client.44262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.101 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='client.44256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.102 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.103 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='client.44262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.104 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.105 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.106 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.107 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.162 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:09:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:09:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:09:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-09-17T01:09:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:09:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:09:07.164 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:09:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='client.44256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='client.44262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:07.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "5/23 daemons upgraded", 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:09:07.554 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:09:07.555 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:09:07.970 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:09:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/328721784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/328721784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='client.44280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.152 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='client.44280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/328721784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='client.44280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:08.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:08.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:08.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:08.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:08.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/499968385' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 613 B/s rd, 0 op/s 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/499968385' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 613 B/s rd, 0 op/s 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: Upgrade: osd.1 is safe to restart 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 679 B/s rd, 0 op/s 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:09.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:09.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: Upgrade: osd.1 is safe to restart 2024-09-17T01:09:09.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 679 B/s rd, 0 op/s 2024-09-17T01:09:09.156 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/499968385' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 613 B/s rd, 0 op/s 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:09.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:09.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: Upgrade: osd.1 is safe to restart 2024-09-17T01:09:09.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:09.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 127 MiB used, 715 GiB / 715 GiB avail; 679 B/s rd, 0 op/s 2024-09-17T01:09:09.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:10.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:10 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:10 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:11.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[96259]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 151 op/s 2024-09-17T01:09:11.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:11.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:11.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[105664]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 151 op/s 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:11 smithi135 ceph-mon[89112]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 151 op/s 2024-09-17T01:09:11.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:11.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:11.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:11.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:12.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:12 smithi071 ceph-mon[105664]: Upgrade: Updating osd.1 2024-09-17T01:09:12.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:12 smithi071 ceph-mon[105664]: Deploying daemon osd.1 on smithi071 2024-09-17T01:09:12.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:12 smithi071 ceph-mon[96259]: Upgrade: Updating osd.1 2024-09-17T01:09:12.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:12 smithi071 ceph-mon[96259]: Deploying daemon osd.1 on smithi071 2024-09-17T01:09:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:12 smithi135 ceph-mon[89112]: Upgrade: Updating osd.1 2024-09-17T01:09:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:12 smithi135 ceph-mon[89112]: Deploying daemon osd.1 on smithi071 2024-09-17T01:09:13.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:13 smithi071 ceph-mon[96259]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:13.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:13 smithi071 ceph-mon[105664]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:13.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:13 smithi135 ceph-mon[89112]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:14.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:14.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:14.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:15.800 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:15 smithi071 ceph-mon[96259]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:15.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:15 smithi071 ceph-mon[105664]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:15.801 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:15 smithi071 systemd[1]: Stopping Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:09:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:15 smithi135 ceph-mon[89112]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:16.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[34812]: 2024-09-17T01:09:15.798+0000 7f9cbb0b6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:09:16.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[34812]: 2024-09-17T01:09:15.798+0000 7f9cbb0b6700 -1 osd.1 123 *** Got signal Terminated *** 2024-09-17T01:09:16.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[34812]: 2024-09-17T01:09:15.798+0000 7f9cbb0b6700 -1 osd.1 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:09:16.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:16 smithi135 ceph-mon[89112]: osd.1 marked itself down and dead 2024-09-17T01:09:16.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:16 smithi071 ceph-mon[96259]: osd.1 marked itself down and dead 2024-09-17T01:09:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:16 smithi071 ceph-mon[105664]: osd.1 marked itself down and dead 2024-09-17T01:09:17.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:09:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:09:16] "GET /metrics HTTP/1.1" 200 38221 "" "Prometheus/2.43.0" 2024-09-17T01:09:17.239 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:16 smithi071 podman[124969]: 2024-09-17 01:09:16.954744769 +0000 UTC m=+1.256847933 container died 530dc8f143cad5dc0546e2cb0e434ac2fd61bb5cb650c36a2e9dc9b45e2f1124 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, release=754, vcs-type=git, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., version=8, RELEASE=HEAD, io.openshift.expose-services=, name=centos-stream, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-09-17T01:09:17.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:17 smithi071 ceph-mon[105664]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:17.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:17 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:17.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:17 smithi071 ceph-mon[105664]: osdmap e124: 8 total, 7 up, 8 in 2024-09-17T01:09:17.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:17 smithi071 ceph-mon[96259]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:17.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:17 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:17.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:17 smithi071 ceph-mon[96259]: osdmap e124: 8 total, 7 up, 8 in 2024-09-17T01:09:17.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:17 smithi071 podman[124969]: 2024-09-17 01:09:17.34117946 +0000 UTC m=+1.643282610 container cleanup 530dc8f143cad5dc0546e2cb0e434ac2fd61bb5cb650c36a2e9dc9b45e2f1124 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, distribution-scope=public, RELEASE=HEAD, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, version=8, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, vendor=Red Hat, Inc., ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, name=centos-stream, GIT_CLEAN=True) 2024-09-17T01:09:17.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:17 smithi071 bash[124969]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:09:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:17 smithi135 ceph-mon[89112]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 0 B/s wr, 150 op/s 2024-09-17T01:09:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:17 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:17 smithi135 ceph-mon[89112]: osdmap e124: 8 total, 7 up, 8 in 2024-09-17T01:09:18.099 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:17 smithi071 podman[124987]: 2024-09-17 01:09:17.734335571 +0000 UTC m=+0.780042211 container remove 530dc8f143cad5dc0546e2cb0e434ac2fd61bb5cb650c36a2e9dc9b45e2f1124 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=HEAD, release=754, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, io.openshift.expose-services=, vendor=Red Hat, Inc., version=8, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, build-date=2022-05-03T08:36:31.336870) 2024-09-17T01:09:18.396 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:18 smithi071 podman[125071]: 2024-09-17 01:09:18.005163603 +0000 UTC m=+0.015860471 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:09:18.396 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:18 smithi071 podman[125071]: 2024-09-17 01:09:18.121723946 +0000 UTC m=+0.132420799 container create b5240b4b4ee8fc9ecd8a36181fbfab1d13621810894ec6b9a2136f27f6c8918d (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-17T01:09:18.396 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:18 smithi071 podman[125071]: 2024-09-17 01:09:18.329101651 +0000 UTC m=+0.339798506 container init b5240b4b4ee8fc9ecd8a36181fbfab1d13621810894ec6b9a2136f27f6c8918d (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-17T01:09:18.397 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:18 smithi071 podman[125071]: 2024-09-17 01:09:18.332326061 +0000 UTC m=+0.343022922 container start b5240b4b4ee8fc9ecd8a36181fbfab1d13621810894ec6b9a2136f27f6c8918d (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T01:09:18.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: osdmap e125: 8 total, 7 up, 8 in 2024-09-17T01:09:18.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-17T01:09:18.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 1]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 4]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.13", "id": [3, 1]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1a", "id": [5, 0]}]: dispatch 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:18.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: osdmap e125: 8 total, 7 up, 8 in 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 1]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 4]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]: dispatch 2024-09-17T01:09:18.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.13", "id": [3, 1]}]: dispatch 2024-09-17T01:09:18.833 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1a", "id": [5, 0]}]: dispatch 2024-09-17T01:09:18.833 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:18.833 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:18.833 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:18 smithi071 podman[125071]: 2024-09-17 01:09:18.412342815 +0000 UTC m=+0.423039687 container attach b5240b4b4ee8fc9ecd8a36181fbfab1d13621810894ec6b9a2136f27f6c8918d (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:09:18.833 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:18 smithi071 podman[125071]: 2024-09-17 01:09:18.521378309 +0000 UTC m=+0.532075167 container died b5240b4b4ee8fc9ecd8a36181fbfab1d13621810894ec6b9a2136f27f6c8918d (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-17T01:09:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: osdmap e125: 8 total, 7 up, 8 in 2024-09-17T01:09:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-17T01:09:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 1]}]: dispatch 2024-09-17T01:09:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 4]}]: dispatch 2024-09-17T01:09:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]: dispatch 2024-09-17T01:09:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 1]}]: dispatch 2024-09-17T01:09:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]: dispatch 2024-09-17T01:09:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.13", "id": [3, 1]}]: dispatch 2024-09-17T01:09:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1a", "id": [5, 0]}]: dispatch 2024-09-17T01:09:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:19.397 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 podman[125095]: 2024-09-17 01:09:19.10808932 +0000 UTC m=+0.577204892 container remove b5240b4b4ee8fc9ecd8a36181fbfab1d13621810894ec6b9a2136f27f6c8918d (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T01:09:19.397 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T01:09:19.397 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 systemd[1]: Stopped Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:09:19.397 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.1.service: Consumed 9.964s CPU time. 2024-09-17T01:09:19.397 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 systemd[1]: Starting Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:09:19.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: pgmap v108: 161 pgs: 20 stale+active+clean, 141 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:09:19.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-17T01:09:19.801 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 1]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 4]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 1]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 1]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.13", "id": [3, 1]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1a", "id": [5, 0]}]': finished 2024-09-17T01:09:19.802 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[105664]: osdmap e126: 8 total, 7 up, 8 in 2024-09-17T01:09:19.802 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 podman[125194]: 2024-09-17 01:09:19.449717427 +0000 UTC m=+0.015748898 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:09:19.803 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 podman[125194]: 2024-09-17 01:09:19.576300293 +0000 UTC m=+0.142331750 container create 09a5617c55560a4fdb894acb7e58188ec36b4ed131c9a955aff78684c49c1656 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:09:19.803 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 podman[125194]: 2024-09-17 01:09:19.803844011 +0000 UTC m=+0.369875471 container init 09a5617c55560a4fdb894acb7e58188ec36b4ed131c9a955aff78684c49c1656 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:09:19.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: pgmap v108: 161 pgs: 20 stale+active+clean, 141 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:09:19.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-17T01:09:19.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 1]}]': finished 2024-09-17T01:09:19.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]': finished 2024-09-17T01:09:19.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 4]}]': finished 2024-09-17T01:09:19.803 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 1]}]': finished 2024-09-17T01:09:19.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]': finished 2024-09-17T01:09:19.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 1]}]': finished 2024-09-17T01:09:19.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]': finished 2024-09-17T01:09:19.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.13", "id": [3, 1]}]': finished 2024-09-17T01:09:19.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1a", "id": [5, 0]}]': finished 2024-09-17T01:09:19.804 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-mon[96259]: osdmap e126: 8 total, 7 up, 8 in 2024-09-17T01:09:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: pgmap v108: 161 pgs: 20 stale+active+clean, 141 active+clean; 585 KiB data, 129 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:09:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-17T01:09:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 1]}]': finished 2024-09-17T01:09:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 1]}]': finished 2024-09-17T01:09:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 4]}]': finished 2024-09-17T01:09:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 1]}]': finished 2024-09-17T01:09:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 1]}]': finished 2024-09-17T01:09:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 1]}]': finished 2024-09-17T01:09:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]': finished 2024-09-17T01:09:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.13", "id": [3, 1]}]': finished 2024-09-17T01:09:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1a", "id": [5, 0]}]': finished 2024-09-17T01:09:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:19 smithi135 ceph-mon[89112]: osdmap e126: 8 total, 7 up, 8 in 2024-09-17T01:09:20.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 podman[125194]: 2024-09-17 01:09:19.807620863 +0000 UTC m=+0.373652321 container start 09a5617c55560a4fdb894acb7e58188ec36b4ed131c9a955aff78684c49c1656 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:09:20.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 podman[125194]: 2024-09-17 01:09:19.895435019 +0000 UTC m=+0.461466491 container attach 09a5617c55560a4fdb894acb7e58188ec36b4ed131c9a955aff78684c49c1656 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-17T01:09:20.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:20.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 bash[125194]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:20.146 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:20.147 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:19 smithi071 bash[125194]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:20 smithi071 ceph-mon[96259]: osdmap e127: 8 total, 7 up, 8 in 2024-09-17T01:09:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:20 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:20 smithi071 ceph-mon[96259]: osdmap e128: 8 total, 7 up, 8 in 2024-09-17T01:09:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:20 smithi071 ceph-mon[105664]: osdmap e127: 8 total, 7 up, 8 in 2024-09-17T01:09:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:20 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:20 smithi071 ceph-mon[105664]: osdmap e128: 8 total, 7 up, 8 in 2024-09-17T01:09:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:20 smithi135 ceph-mon[89112]: osdmap e127: 8 total, 7 up, 8 in 2024-09-17T01:09:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:20 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:20 smithi135 ceph-mon[89112]: osdmap e128: 8 total, 7 up, 8 in 2024-09-17T01:09:21.299 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:21.300 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 bash[125194]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:21.300 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:21.300 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 bash[125194]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:21.300 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:21.300 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 bash[125194]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:21.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-mon[105664]: pgmap v111: 161 pgs: 2 unknown, 38 active+undersized, 7 peering, 22 active+undersized+degraded, 92 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 101/726 objects degraded (13.912%) 2024-09-17T01:09:21.602 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 101/726 objects degraded (13.912%), 22 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:21.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-mon[96259]: pgmap v111: 161 pgs: 2 unknown, 38 active+undersized, 7 peering, 22 active+undersized+degraded, 92 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 101/726 objects degraded (13.912%) 2024-09-17T01:09:21.602 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 101/726 objects degraded (13.912%), 22 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 bash[125194]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 bash[125194]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 bash[125194]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[125208]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 bash[125194]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:09:21.603 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 podman[125194]: 2024-09-17 01:09:21.331398769 +0000 UTC m=+1.897430243 container died 09a5617c55560a4fdb894acb7e58188ec36b4ed131c9a955aff78684c49c1656 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-17T01:09:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:21 smithi135 ceph-mon[89112]: pgmap v111: 161 pgs: 2 unknown, 38 active+undersized, 7 peering, 22 active+undersized+degraded, 92 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 101/726 objects degraded (13.912%) 2024-09-17T01:09:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:21 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 101/726 objects degraded (13.912%), 22 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:22.189 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:21 smithi071 podman[125355]: 2024-09-17 01:09:21.932627071 +0000 UTC m=+0.595121312 container remove 09a5617c55560a4fdb894acb7e58188ec36b4ed131c9a955aff78684c49c1656 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-17T01:09:22.189 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:22 smithi071 podman[125423]: 2024-09-17 01:09:22.059945091 +0000 UTC m=+0.017712335 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:09:22.189 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:22 smithi071 podman[125423]: 2024-09-17 01:09:22.192098924 +0000 UTC m=+0.149866153 container create 943abede30d67754819e4798cb5c199bff7ebddbea6b81ca97c5c7b190bd02d9 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T01:09:22.739 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:22 smithi071 podman[125423]: 2024-09-17 01:09:22.445205024 +0000 UTC m=+0.402972254 container init 943abede30d67754819e4798cb5c199bff7ebddbea6b81ca97c5c7b190bd02d9 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-17T01:09:22.739 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:22 smithi071 podman[125423]: 2024-09-17 01:09:22.448709868 +0000 UTC m=+0.406477099 container start 943abede30d67754819e4798cb5c199bff7ebddbea6b81ca97c5c7b190bd02d9 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:09:22.739 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:22 smithi071 ceph-osd[125442]: -- 172.21.15.71:0/1106577851 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e72225a40 con 0x559e72fec000 2024-09-17T01:09:22.739 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:22 smithi071 bash[125423]: 943abede30d67754819e4798cb5c199bff7ebddbea6b81ca97c5c7b190bd02d9 2024-09-17T01:09:22.739 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:22 smithi071 systemd[1]: Started Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:09:23.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: pgmap v113: 161 pgs: 2 unknown, 38 active+undersized, 7 peering, 22 active+undersized+degraded, 92 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 101/726 objects degraded (13.912%) 2024-09-17T01:09:23.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: pgmap v113: 161 pgs: 2 unknown, 38 active+undersized, 7 peering, 22 active+undersized+degraded, 92 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 101/726 objects degraded (13.912%) 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: pgmap v113: 161 pgs: 2 unknown, 38 active+undersized, 7 peering, 22 active+undersized+degraded, 92 active+clean; 585 KiB data, 134 MiB used, 715 GiB / 715 GiB avail; 101/726 objects degraded (13.912%) 2024-09-17T01:09:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.503 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[125437]: 2024-09-17T01:09:24.367+0000 7fb63368e640 -1 Falling back to public interface 2024-09-17T01:09:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.816 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.816 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.816 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.819 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.820 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.822 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:24.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:24.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: pgmap v114: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 117 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 177 B/s, 0 objects/s recovering 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: pgmap v114: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 117 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 177 B/s, 0 objects/s recovering 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: pgmap v114: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 0 B/s wr, 117 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 177 B/s, 0 objects/s recovering 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:26.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:09:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:09:26] "GET /metrics HTTP/1.1" 200 38363 "" "Prometheus/2.43.0" 2024-09-17T01:09:27.868 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[125437]: 2024-09-17T01:09:27.671+0000 7fb63368e640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-17T01:09:27.869 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[125437]: 2024-09-17T01:09:27.701+0000 7fb63368e640 -1 osd.1 123 log_to_monitors true 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: pgmap v115: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 0 B/s wr, 88 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 133 B/s, 0 objects/s recovering 2024-09-17T01:09:27.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.870 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: pgmap v115: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 0 B/s wr, 88 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 133 B/s, 0 objects/s recovering 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.872 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: pgmap v115: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 0 B/s wr, 88 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 133 B/s, 0 objects/s recovering 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:27.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:27.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:27.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.872 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.873 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.874 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.875 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.876 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.879 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:28.880 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:28.881 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[125437]: 2024-09-17T01:09:28.669+0000 7fb62b439640 -1 osd.1 123 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: pgmap v116: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 0 B/s wr, 80 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 118 B/s, 0 objects/s recovering 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.821 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: osdmap e129: 8 total, 7 up, 8 in 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.822 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.823 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: pgmap v116: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 0 B/s wr, 80 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 118 B/s, 0 objects/s recovering 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: osdmap e129: 8 total, 7 up, 8 in 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.825 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.826 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.828 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.829 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.830 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: pgmap v116: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 139 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s rd, 0 B/s wr, 80 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%); 118 B/s, 0 objects/s recovering 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: osdmap e129: 8 total, 7 up, 8 in 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:29.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:29.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:29.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:29.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:29.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:30.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.823 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Upgrade: osd.1 is safe to restart 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035] boot 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: osdmap e130: 8 total, 8 up, 8 in 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:30.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[96259]: osdmap e131: 8 total, 8 up, 8 in 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Upgrade: osd.1 is safe to restart 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035] boot 2024-09-17T01:09:30.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: osdmap e130: 8 total, 8 up, 8 in 2024-09-17T01:09:30.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:30.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:30 smithi071 ceph-mon[105664]: osdmap e131: 8 total, 8 up, 8 in 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:09:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Upgrade: osd.1 is safe to restart 2024-09-17T01:09:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: osd.1 [v2:172.21.15.71:6808/654258035,v1:172.21.15.71:6809/654258035] boot 2024-09-17T01:09:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: osdmap e130: 8 total, 8 up, 8 in 2024-09-17T01:09:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:30 smithi135 ceph-mon[89112]: osdmap e131: 8 total, 8 up, 8 in 2024-09-17T01:09:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:31 smithi135 ceph-mon[89112]: pgmap v120: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%) 2024-09-17T01:09:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:31 smithi135 ceph-mon[89112]: osdmap e132: 8 total, 8 up, 8 in 2024-09-17T01:09:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[105664]: pgmap v120: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%) 2024-09-17T01:09:31.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:31.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[105664]: osdmap e132: 8 total, 8 up, 8 in 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[96259]: pgmap v120: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%) 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[96259]: osdmap e132: 8 total, 8 up, 8 in 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:32.666 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:32 smithi071 ceph-mon[105664]: Upgrade: Updating osd.1 2024-09-17T01:09:32.667 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:32 smithi071 ceph-mon[105664]: Deploying daemon osd.1 on smithi071 2024-09-17T01:09:32.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:32 smithi071 ceph-mon[96259]: Upgrade: Updating osd.1 2024-09-17T01:09:32.667 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:32 smithi071 ceph-mon[96259]: Deploying daemon osd.1 on smithi071 2024-09-17T01:09:32.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:32 smithi135 ceph-mon[89112]: Upgrade: Updating osd.1 2024-09-17T01:09:32.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:32 smithi135 ceph-mon[89112]: Deploying daemon osd.1 on smithi071 2024-09-17T01:09:33.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:33 smithi071 ceph-mon[96259]: pgmap v122: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 179 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%) 2024-09-17T01:09:33.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:33.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:33.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:33 smithi071 ceph-mon[105664]: pgmap v122: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 179 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%) 2024-09-17T01:09:33.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:33.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:33 smithi135 ceph-mon[89112]: pgmap v122: 161 pgs: 10 active+clean+remapped, 38 active+undersized, 22 active+undersized+degraded, 91 active+clean; 585 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 179 op/s; 101/726 objects degraded (13.912%); 5/726 objects misplaced (0.689%) 2024-09-17T01:09:33.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:33.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:34.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:34 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 101/726 objects degraded (13.912%), 22 pgs degraded) 2024-09-17T01:09:34.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:34 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:09:34.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:34 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 101/726 objects degraded (13.912%), 22 pgs degraded) 2024-09-17T01:09:34.625 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:34 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:09:34.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:34 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 101/726 objects degraded (13.912%), 22 pgs degraded) 2024-09-17T01:09:34.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:34 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:09:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:35 smithi071 ceph-mon[96259]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 76 KiB/s rd, 0 B/s wr, 125 op/s; 1 B/s, 10 objects/s recovering 2024-09-17T01:09:35.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:35 smithi071 ceph-mon[105664]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 76 KiB/s rd, 0 B/s wr, 125 op/s; 1 B/s, 10 objects/s recovering 2024-09-17T01:09:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:35 smithi135 ceph-mon[89112]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 76 KiB/s rd, 0 B/s wr, 125 op/s; 1 B/s, 10 objects/s recovering 2024-09-17T01:09:37.172 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:09:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:09:36] "GET /metrics HTTP/1.1" 200 38299 "" "Prometheus/2.43.0" 2024-09-17T01:09:37.365 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:37 smithi071 systemd[1]: Stopping Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[96259]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 753 B/s rd, 0 op/s; 1 B/s, 8 objects/s recovering 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.366 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-mon[105664]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 753 B/s rd, 0 op/s; 1 B/s, 8 objects/s recovering 2024-09-17T01:09:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:37 smithi135 ceph-mon[89112]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 753 B/s rd, 0 op/s; 1 B/s, 8 objects/s recovering 2024-09-17T01:09:37.646 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[125437]: 2024-09-17T01:09:37.476+0000 7fb630626640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:09:37.646 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[125437]: 2024-09-17T01:09:37.476+0000 7fb630626640 -1 osd.1 132 *** Got signal Terminated *** 2024-09-17T01:09:37.646 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:37 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[125437]: 2024-09-17T01:09:37.476+0000 7fb630626640 -1 osd.1 132 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:09:38.329 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:09:38.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[96259]: osd.1 marked itself down and dead 2024-09-17T01:09:38.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:38 smithi071 ceph-mon[105664]: osd.1 marked itself down and dead 2024-09-17T01:09:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:38.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:38 smithi135 ceph-mon[89112]: osd.1 marked itself down and dead 2024-09-17T01:09:39.011 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:09:39.011 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 1s ago 16m - - 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 7s ago 16m - - 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (6m) 1s ago 12m 25.1M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (5m) 7s ago 11m 53.7M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (4m) 1s ago 10m 57.3M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (5m) 7s ago 16m 514M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (3m) 1s ago 17m 441M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (3m) 1s ago 17m 54.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (2m) 7s ago 16m 40.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (2m) 1s ago 16m 45.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (6m) 1s ago 12m 15.6M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (6m) 7s ago 12m 16.3M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:09:39.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (46s) 1s ago 15m 48.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (16s) 1s ago 15m 48.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 943abede30d6 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (15m) 1s ago 15m 55.7M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (14m) 1s ago 14m 63.7M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (14m) 7s ago 14m 61.4M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (13m) 7s ago 13m 57.1M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (13m) 7s ago 13m 56.0M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (13m) 7s ago 13m 62.7M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (4m) 7s ago 12m 62.9M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (10m) 1s ago 10m 76.7M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (10m) 7s ago 10m 75.0M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (10m) 1s ago 10m 75.0M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:09:39.013 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (10m) 7s ago 10m 75.1M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:09:39.014 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:38 smithi071 podman[129114]: 2024-09-17 01:09:38.729280916 +0000 UTC m=+1.354246179 container died 943abede30d67754819e4798cb5c199bff7ebddbea6b81ca97c5c7b190bd02d9 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T01:09:39.429 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:09:39.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:09:39.429 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:09:39.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:39.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:09:39.429 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:39.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:09:39.430 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:09:39.592 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[96259]: from='client.64264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:39.592 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:39.592 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[96259]: osdmap e133: 8 total, 7 up, 8 in 2024-09-17T01:09:39.592 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[96259]: pgmap v126: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 1 B/s, 7 objects/s recovering 2024-09-17T01:09:39.592 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[105664]: from='client.64264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:39.592 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:39.593 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[105664]: osdmap e133: 8 total, 7 up, 8 in 2024-09-17T01:09:39.593 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:39 smithi071 ceph-mon[105664]: pgmap v126: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 1 B/s, 7 objects/s recovering 2024-09-17T01:09:39.593 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:39 smithi071 podman[129114]: 2024-09-17 01:09:39.34278511 +0000 UTC m=+1.967750358 container cleanup 943abede30d67754819e4798cb5c199bff7ebddbea6b81ca97c5c7b190bd02d9 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T01:09:39.593 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:39 smithi071 bash[129114]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:09:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:39 smithi135 ceph-mon[89112]: from='client.64264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:39 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:39 smithi135 ceph-mon[89112]: osdmap e133: 8 total, 7 up, 8 in 2024-09-17T01:09:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:39 smithi135 ceph-mon[89112]: pgmap v126: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 1 B/s, 7 objects/s recovering 2024-09-17T01:09:39.789 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:09:39.789 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:09:39.789 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:09:39.789 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:09:39.789 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:09:39.790 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:09:39.790 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:09:39.790 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:09:39.790 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "7/23 daemons upgraded", 2024-09-17T01:09:39.790 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:09:39.790 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:09:39.790 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:09:39.896 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:39 smithi071 podman[129181]: 2024-09-17 01:09:39.594726558 +0000 UTC m=+0.866385623 container remove 943abede30d67754819e4798cb5c199bff7ebddbea6b81ca97c5c7b190bd02d9 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:09:40.216 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down 2024-09-17T01:09:40.216 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:09:40.216 INFO:teuthology.orchestra.run.smithi071.stdout: osd.1 (root=default,host=smithi071) is down 2024-09-17T01:09:40.304 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:40 smithi071 podman[129355]: 2024-09-17 01:09:39.937785018 +0000 UTC m=+0.021766250 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:09:40.304 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:40 smithi071 podman[129355]: 2024-09-17 01:09:40.054073814 +0000 UTC m=+0.138055038 container create c4f28bad72eed99d3cc1c44a4d92d8dff1446fe1b2f1baa28287db8d1b5dfa20 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:09:40.304 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:40 smithi071 podman[129355]: 2024-09-17 01:09:40.30674527 +0000 UTC m=+0.390726501 container init c4f28bad72eed99d3cc1c44a4d92d8dff1446fe1b2f1baa28287db8d1b5dfa20 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:09:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[96259]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[96259]: from='client.64276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[96259]: osdmap e134: 8 total, 7 up, 8 in 2024-09-17T01:09:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1991119395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:40.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/4016086565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[105664]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[105664]: from='client.64276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[105664]: osdmap e134: 8 total, 7 up, 8 in 2024-09-17T01:09:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1991119395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:40 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/4016086565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:40.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:40 smithi071 podman[129355]: 2024-09-17 01:09:40.310454322 +0000 UTC m=+0.394435557 container start c4f28bad72eed99d3cc1c44a4d92d8dff1446fe1b2f1baa28287db8d1b5dfa20 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T01:09:40.648 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:40 smithi071 podman[129355]: 2024-09-17 01:09:40.398299568 +0000 UTC m=+0.482280804 container attach c4f28bad72eed99d3cc1c44a4d92d8dff1446fe1b2f1baa28287db8d1b5dfa20 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T01:09:40.648 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:40 smithi071 podman[129355]: 2024-09-17 01:09:40.506782124 +0000 UTC m=+0.590763350 container died c4f28bad72eed99d3cc1c44a4d92d8dff1446fe1b2f1baa28287db8d1b5dfa20 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97) 2024-09-17T01:09:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:40 smithi135 ceph-mon[89112]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:40 smithi135 ceph-mon[89112]: from='client.64276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:40 smithi135 ceph-mon[89112]: osdmap e134: 8 total, 7 up, 8 in 2024-09-17T01:09:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:40 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1991119395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:40 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:40 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/4016086565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:41.378 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 podman[129388]: 2024-09-17 01:09:41.15227063 +0000 UTC m=+0.639653975 container remove c4f28bad72eed99d3cc1c44a4d92d8dff1446fe1b2f1baa28287db8d1b5dfa20 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T01:09:41.378 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T01:09:41.378 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 systemd[1]: Stopped Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:09:41.378 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.1.service: Consumed 1.914s CPU time. 2024-09-17T01:09:41.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:41 smithi071 ceph-mon[96259]: from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:41.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:41 smithi071 ceph-mon[96259]: pgmap v128: 161 pgs: 67 peering, 3 stale+active+clean, 91 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1 B/s, 4 objects/s recovering 2024-09-17T01:09:41.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:41 smithi071 ceph-mon[105664]: from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:41.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:41 smithi071 ceph-mon[105664]: pgmap v128: 161 pgs: 67 peering, 3 stale+active+clean, 91 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1 B/s, 4 objects/s recovering 2024-09-17T01:09:41.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 systemd[1]: Starting Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:09:41.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 podman[129487]: 2024-09-17 01:09:41.496527791 +0000 UTC m=+0.015959742 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:09:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:41 smithi135 ceph-mon[89112]: from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:41 smithi135 ceph-mon[89112]: pgmap v128: 161 pgs: 67 peering, 3 stale+active+clean, 91 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 1 B/s, 4 objects/s recovering 2024-09-17T01:09:41.920 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 podman[129487]: 2024-09-17 01:09:41.670046131 +0000 UTC m=+0.189478114 container create 89b31a39682d03a14f7f231d9fe290adc6a0a341c9de89c0dd4213d66f2c5f6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:09:41.920 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 podman[129487]: 2024-09-17 01:09:41.92269022 +0000 UTC m=+0.442122168 container init 89b31a39682d03a14f7f231d9fe290adc6a0a341c9de89c0dd4213d66f2c5f6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:09:42.381 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:41 smithi071 podman[129487]: 2024-09-17 01:09:41.926246173 +0000 UTC m=+0.445678121 container start 89b31a39682d03a14f7f231d9fe290adc6a0a341c9de89c0dd4213d66f2c5f6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:09:42.381 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:42 smithi071 podman[129487]: 2024-09-17 01:09:42.014500669 +0000 UTC m=+0.533932624 container attach 89b31a39682d03a14f7f231d9fe290adc6a0a341c9de89c0dd4213d66f2c5f6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T01:09:42.381 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:42 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:42.382 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:42 smithi071 bash[129487]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:42.382 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:42 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:42.382 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:42 smithi071 bash[129487]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:42.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:42 smithi071 ceph-mon[96259]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-09-17T01:09:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:42 smithi071 ceph-mon[105664]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-09-17T01:09:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:42 smithi135 ceph-mon[89112]: Health check failed: Reduced data availability: 7 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2024-09-17T01:09:43.386 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:43.387 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 bash[129487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:43.387 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:43.387 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 bash[129487]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:43.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-mon[96259]: pgmap v129: 161 pgs: 67 peering, 3 stale+active+clean, 91 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:09:43.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-mon[105664]: pgmap v129: 161 pgs: 67 peering, 3 stale+active+clean, 91 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 bash[129487]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 bash[129487]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 bash[129487]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 bash[129487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate[129502]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 bash[129487]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:09:43.647 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:43 smithi071 podman[129487]: 2024-09-17 01:09:43.460596881 +0000 UTC m=+1.980028826 container died 89b31a39682d03a14f7f231d9fe290adc6a0a341c9de89c0dd4213d66f2c5f6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T01:09:43.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:43 smithi135 ceph-mon[89112]: pgmap v129: 161 pgs: 67 peering, 3 stale+active+clean, 91 active+clean; 585 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:09:44.472 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 podman[129644]: 2024-09-17 01:09:44.176455169 +0000 UTC m=+0.709332307 container remove 89b31a39682d03a14f7f231d9fe290adc6a0a341c9de89c0dd4213d66f2c5f6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:09:44.473 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 podman[129702]: 2024-09-17 01:09:44.290850693 +0000 UTC m=+0.015987340 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:09:44.473 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 podman[129702]: 2024-09-17 01:09:44.393915357 +0000 UTC m=+0.119052001 container create cd1cf4e04194924b47c88aa9a426d7a195a297caf8242c77181597f2b90d18eb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T01:09:44.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:44.811 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:44.811 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.125 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 podman[129702]: 2024-09-17 01:09:44.814041062 +0000 UTC m=+0.539177706 container init cd1cf4e04194924b47c88aa9a426d7a195a297caf8242c77181597f2b90d18eb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T01:09:45.125 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 podman[129702]: 2024-09-17 01:09:44.817838889 +0000 UTC m=+0.542975525 container start cd1cf4e04194924b47c88aa9a426d7a195a297caf8242c77181597f2b90d18eb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-17T01:09:45.125 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 ceph-osd[129720]: -- 172.21.15.71:0/1101001980 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e63066ba40 con 0x55e631432000 2024-09-17T01:09:45.125 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 bash[129702]: cd1cf4e04194924b47c88aa9a426d7a195a297caf8242c77181597f2b90d18eb 2024-09-17T01:09:45.125 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:44 smithi071 systemd[1]: Started Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:09:45.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: pgmap v130: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:45.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 106/726 objects degraded (14.601%), 26 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:45.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: pgmap v130: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 106/726 objects degraded (14.601%), 26 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:45 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: pgmap v130: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 106/726 objects degraded (14.601%), 26 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 7 pgs peering) 2024-09-17T01:09:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:45 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.731 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.731 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.731 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.732 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.735 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.736 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.740 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.776 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.777 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:46.778 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:46.997 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[129716]: 2024-09-17T01:09:46.733+0000 7f5723490640 -1 Falling back to public interface 2024-09-17T01:09:47.027 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:09:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:09:46] "GET /metrics HTTP/1.1" 200 38299 "" "Prometheus/2.43.0" 2024-09-17T01:09:47.576 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: pgmap v131: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.577 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.578 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: pgmap v131: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.580 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.581 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.582 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.583 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.584 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.585 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.585 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.585 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.585 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.585 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.585 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.585 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: pgmap v131: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:47.898 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:47.899 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:47.899 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.899 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:47.899 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.750 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.751 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.752 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.755 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.756 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.757 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.758 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.759 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:48.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.608 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: pgmap v132: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: pgmap v132: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:49.611 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.615 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.669 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.669 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.669 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.669 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: pgmap v132: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.670 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.671 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.672 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:49.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:49.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:49.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:49.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:49.673 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.483 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[129716]: 2024-09-17T01:09:50.312+0000 7f5723490640 -1 osd.1 132 log_to_monitors true 2024-09-17T01:09:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:50.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:50.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.911 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.911 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.911 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.911 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.911 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.911 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:50.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:50.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:50.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:50.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:50.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.823 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[129716]: 2024-09-17T01:09:51.737+0000 7f5717233640 -1 osd.1 132 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: pgmap v133: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 923 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.824 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:09:51.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: osdmap e135: 8 total, 7 up, 8 in 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.828 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: pgmap v133: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 923 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.829 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: osdmap e135: 8 total, 7 up, 8 in 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.831 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: pgmap v133: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 923 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: osdmap e135: 8 total, 7 up, 8 in 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:09:51.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:51.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:51.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:51.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:51.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:51.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='osd.1 ' entity='osd.1' 2024-09-17T01:09:52.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.882 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='osd.1 ' entity='osd.1' 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.885 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: pgmap v135: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.887 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.889 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: pgmap v135: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.890 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.891 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.891 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.891 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.891 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='osd.1 ' entity='osd.1' 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: pgmap v135: 161 pgs: 44 active+undersized, 26 active+undersized+degraded, 91 active+clean; 585 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s; 106/726 objects degraded (14.601%) 2024-09-17T01:09:52.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:52.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588] boot 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: osdmap e136: 8 total, 8 up, 8 in 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:53.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.065 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.065 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.065 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.065 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.065 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.065 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.065 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:54.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588] boot 2024-09-17T01:09:54.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: osdmap e136: 8 total, 8 up, 8 in 2024-09-17T01:09:54.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:54.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.068 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.069 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.070 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: osd.1 [v2:172.21.15.71:6808/438932588,v1:172.21.15.71:6809/438932588] boot 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: osdmap e136: 8 total, 8 up, 8 in 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.071 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.072 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.074 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.075 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: osdmap e137: 8 total, 8 up, 8 in 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.880 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: pgmap v138: 161 pgs: 16 active+undersized, 7 active+undersized+degraded, 138 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 39/726 objects degraded (5.372%) 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.881 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.882 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: osdmap e137: 8 total, 8 up, 8 in 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.883 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.884 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: pgmap v138: 161 pgs: 16 active+undersized, 7 active+undersized+degraded, 138 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 39/726 objects degraded (5.372%) 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.885 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: osdmap e137: 8 total, 8 up, 8 in 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: pgmap v138: 161 pgs: 16 active+undersized, 7 active+undersized+degraded, 138 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 39/726 objects degraded (5.372%) 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:54.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:54.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:54.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 39/726 objects degraded (5.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 39/726 objects degraded (5.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 39/726 objects degraded (5.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:55.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:55.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.460 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:09:56.193+0000 7f82703f1640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-09-17T01:09:56.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:09:56] "GET /metrics HTTP/1.1" 200 38452 "" "Prometheus/2.43.0" 2024-09-17T01:09:56.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:56.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-09-17T01:09:56.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:56 smithi135 ceph-mon[89112]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:09:57.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.023 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.025 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[96259]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.026 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.027 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:57.028 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:57.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:57.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:09:57.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:09:57.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-09-17T01:09:57.029 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:56 smithi071 ceph-mon[105664]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:09:57.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:57 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/726 objects degraded (5.372%), 7 pgs degraded) 2024-09-17T01:09:57.760 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:57 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:09:57.760 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:57 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/726 objects degraded (5.372%), 7 pgs degraded) 2024-09-17T01:09:57.760 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:57 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:09:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:57 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/726 objects degraded (5.372%), 7 pgs degraded) 2024-09-17T01:09:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:57 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:09:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[96259]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 709 B/s rd, 0 op/s 2024-09-17T01:09:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:58 smithi071 ceph-mon[105664]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 709 B/s rd, 0 op/s 2024-09-17T01:09:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:09:59.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:58 smithi135 ceph-mon[89112]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 709 B/s rd, 0 op/s 2024-09-17T01:09:59.816 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:09:59 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:09:59.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:09:59 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:00.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:09:59 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:00 smithi071 ceph-mon[96259]: overall HEALTH_OK 2024-09-17T01:10:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:00 smithi071 ceph-mon[96259]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:00.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:00 smithi071 ceph-mon[105664]: overall HEALTH_OK 2024-09-17T01:10:00.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:00 smithi071 ceph-mon[105664]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:00 smithi135 ceph-mon[89112]: overall HEALTH_OK 2024-09-17T01:10:01.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:00 smithi135 ceph-mon[89112]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:03.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[96259]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:10:03.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:03.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:03.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[105664]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:10:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:03 smithi135 ceph-mon[89112]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:10:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:05 smithi071 ceph-mon[96259]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:10:05.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:05 smithi071 ceph-mon[105664]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:10:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:05 smithi135 ceph-mon[89112]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:10:07.184 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:10:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:10:06] "GET /metrics HTTP/1.1" 200 38438 "" "Prometheus/2.43.0" 2024-09-17T01:10:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:07 smithi071 ceph-mon[96259]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:07 smithi071 ceph-mon[105664]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:07.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:07 smithi135 ceph-mon[89112]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:09.732 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:09 smithi135 ceph-mon[89112]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:09 smithi071 ceph-mon[96259]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:09.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:09 smithi071 ceph-mon[105664]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:10.588 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:10:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:10 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:10.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:10 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:10 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:11.235 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:10:11.235 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 13s ago 17m - - 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 19s ago 17m - - 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (7m) 13s ago 12m 25.2M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (6m) 19s ago 12m 53.2M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (5m) 13s ago 10m 57.3M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (5m) 19s ago 16m 515M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (4m) 13s ago 18m 441M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (3m) 13s ago 18m 56.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (2m) 19s ago 16m 38.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (2m) 13s ago 17m 48.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (7m) 13s ago 12m 15.2M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:10:11.236 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (6m) 19s ago 12m 16.4M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (78s) 13s ago 16m 49.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (26s) 13s ago 16m 52.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (15m) 13s ago 15m 56.1M 4096M 17.2.0 e1d6a67b021e e186e40f58ce 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (15m) 13s ago 15m 64.7M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (14m) 19s ago 14m 62.6M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (14m) 19s ago 14m 58.0M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (14m) 19s ago 14m 56.6M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (13m) 19s ago 13m 63.0M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (5m) 19s ago 13m 63.9M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (11m) 13s ago 11m 76.7M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:10:11.237 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (11m) 19s ago 11m 75.1M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:10:11.238 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (10m) 13s ago 10m 75.1M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:10:11.238 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (10m) 19s ago 10m 75.3M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-09-17T01:10:11.658 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:10:11.659 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:10:11.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:11 smithi135 ceph-mon[89112]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:11.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:11 smithi135 ceph-mon[89112]: from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:11.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:11 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:10:11.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:11 smithi071 ceph-mon[105664]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:11.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:11 smithi071 ceph-mon[105664]: from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:11.886 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:11 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:10:11.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:11 smithi071 ceph-mon[96259]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:11.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:11 smithi071 ceph-mon[96259]: from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:11.886 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:11 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:10:12.008 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:10:12.009 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "7/23 daemons upgraded", 2024-09-17T01:10:12.009 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:10:12.009 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:10:12.009 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:10:12.410 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: Upgrade: osd.2 is safe to restart 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='client.44352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1323681504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.690 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1529856472' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: Upgrade: osd.2 is safe to restart 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='client.44352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1323681504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.691 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:12 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1529856472' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:10:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: Upgrade: osd.2 is safe to restart 2024-09-17T01:10:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='client.44352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:12.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1323681504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:12.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:12.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:12 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1529856472' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:13.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:13 smithi135 ceph-mon[89112]: from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:13.863 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:13 smithi135 ceph-mon[89112]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:13.863 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:13.863 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:10:13.863 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[96259]: from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[96259]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:10:13.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[105664]: from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[105664]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:10:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:14.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:14 smithi071 ceph-mon[105664]: Upgrade: Updating osd.2 2024-09-17T01:10:14.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:14 smithi071 ceph-mon[105664]: Deploying daemon osd.2 on smithi071 2024-09-17T01:10:14.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:14 smithi071 ceph-mon[96259]: Upgrade: Updating osd.2 2024-09-17T01:10:14.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:14 smithi071 ceph-mon[96259]: Deploying daemon osd.2 on smithi071 2024-09-17T01:10:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:14 smithi135 ceph-mon[89112]: Upgrade: Updating osd.2 2024-09-17T01:10:14.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:14 smithi135 ceph-mon[89112]: Deploying daemon osd.2 on smithi071 2024-09-17T01:10:15.878 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:15 smithi071 ceph-mon[96259]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:15.879 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:15 smithi071 ceph-mon[105664]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:15 smithi135 ceph-mon[89112]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:10:16.146 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:16 smithi071 systemd[1]: Stopping Ceph osd.2 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:10:16.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:16 smithi071 ceph-mon[96259]: osd.2 marked itself down and dead 2024-09-17T01:10:16.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:16 smithi071 ceph-mon[105664]: osd.2 marked itself down and dead 2024-09-17T01:10:16.647 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[37728]: 2024-09-17T01:10:16.361+0000 7fe4f0726700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:10:16.647 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[37728]: 2024-09-17T01:10:16.361+0000 7fe4f0726700 -1 osd.2 137 *** Got signal Terminated *** 2024-09-17T01:10:16.647 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[37728]: 2024-09-17T01:10:16.361+0000 7fe4f0726700 -1 osd.2 137 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:10:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:16 smithi135 ceph-mon[89112]: osd.2 marked itself down and dead 2024-09-17T01:10:16.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:10:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:10:16] "GET /metrics HTTP/1.1" 200 38438 "" "Prometheus/2.43.0" 2024-09-17T01:10:17.335 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:17 smithi071 podman[135138]: 2024-09-17 01:10:17.066917449 +0000 UTC m=+0.846239031 container died e186e40f58ce41c61924607168b924135078e0758e105d1c20e4362fa7c1d4d6 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, architecture=x86_64, GIT_CLEAN=True, name=centos-stream, vcs-type=git, com.redhat.component=centos-stream-container, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD) 2024-09-17T01:10:17.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:17 smithi071 ceph-mon[96259]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:17.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:17 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:17.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:17 smithi071 ceph-mon[96259]: osdmap e138: 8 total, 7 up, 8 in 2024-09-17T01:10:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:17 smithi071 ceph-mon[105664]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:17 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:17.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:17 smithi071 ceph-mon[105664]: osdmap e138: 8 total, 7 up, 8 in 2024-09-17T01:10:17.647 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:17 smithi071 podman[135138]: 2024-09-17 01:10:17.503566731 +0000 UTC m=+1.282888332 container cleanup e186e40f58ce41c61924607168b924135078e0758e105d1c20e4362fa7c1d4d6 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, version=8, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, release=754, name=centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., io.buildah.version=1.19.8, ceph=True, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, RELEASE=HEAD, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux ) 2024-09-17T01:10:17.648 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:17 smithi071 bash[135138]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:10:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:17 smithi135 ceph-mon[89112]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:17 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:17 smithi135 ceph-mon[89112]: osdmap e138: 8 total, 7 up, 8 in 2024-09-17T01:10:18.126 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:17 smithi071 podman[135152]: 2024-09-17 01:10:17.696875775 +0000 UTC m=+0.631141386 container remove e186e40f58ce41c61924607168b924135078e0758e105d1c20e4362fa7c1d4d6 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, release=754, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, vendor=Red Hat, Inc., GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, com.redhat.component=centos-stream-container, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, maintainer=Guillaume Abrioux , io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-09-17T01:10:18.389 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:18 smithi071 podman[135266]: 2024-09-17 01:10:18.031729408 +0000 UTC m=+0.015759507 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:10:18.389 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:18 smithi071 podman[135266]: 2024-09-17 01:10:18.147763126 +0000 UTC m=+0.131793258 container create 9d1d7facf57f8b4318ff5e172b2cfcfefdd7f0b6250d32e2ae267072ca05daac (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:10:18.389 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:18 smithi071 podman[135266]: 2024-09-17 01:10:18.391745828 +0000 UTC m=+0.375775933 container init 9d1d7facf57f8b4318ff5e172b2cfcfefdd7f0b6250d32e2ae267072ca05daac (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T01:10:18.646 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:18 smithi071 podman[135266]: 2024-09-17 01:10:18.395160892 +0000 UTC m=+0.379190981 container start 9d1d7facf57f8b4318ff5e172b2cfcfefdd7f0b6250d32e2ae267072ca05daac (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:10:18.646 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:18 smithi071 podman[135266]: 2024-09-17 01:10:18.525282517 +0000 UTC m=+0.509312616 container attach 9d1d7facf57f8b4318ff5e172b2cfcfefdd7f0b6250d32e2ae267072ca05daac (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-17T01:10:18.646 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:18 smithi071 podman[135266]: 2024-09-17 01:10:18.590610085 +0000 UTC m=+0.574640178 container died 9d1d7facf57f8b4318ff5e172b2cfcfefdd7f0b6250d32e2ae267072ca05daac (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: osdmap e139: 8 total, 7 up, 8 in 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.3", "id": [5, 2]}]: dispatch 2024-09-17T01:10:18.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.b", "id": [0, 6]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 2]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 2]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [7, 2]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]: dispatch 2024-09-17T01:10:18.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]: dispatch 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: osdmap e139: 8 total, 7 up, 8 in 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.3", "id": [5, 2]}]: dispatch 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.b", "id": [0, 6]}]: dispatch 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]: dispatch 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3]}]: dispatch 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]: dispatch 2024-09-17T01:10:18.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 2]}]: dispatch 2024-09-17T01:10:18.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 2]}]: dispatch 2024-09-17T01:10:18.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [7, 2]}]: dispatch 2024-09-17T01:10:18.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]: dispatch 2024-09-17T01:10:18.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]: dispatch 2024-09-17T01:10:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: osdmap e139: 8 total, 7 up, 8 in 2024-09-17T01:10:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.3", "id": [5, 2]}]: dispatch 2024-09-17T01:10:18.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.b", "id": [0, 6]}]: dispatch 2024-09-17T01:10:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]: dispatch 2024-09-17T01:10:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3]}]: dispatch 2024-09-17T01:10:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]: dispatch 2024-09-17T01:10:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 2]}]: dispatch 2024-09-17T01:10:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 2]}]: dispatch 2024-09-17T01:10:18.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [7, 2]}]: dispatch 2024-09-17T01:10:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]: dispatch 2024-09-17T01:10:18.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]: dispatch 2024-09-17T01:10:19.501 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:19 smithi071 podman[135289]: 2024-09-17 01:10:19.354498061 +0000 UTC m=+0.751868563 container remove 9d1d7facf57f8b4318ff5e172b2cfcfefdd7f0b6250d32e2ae267072ca05daac (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-17T01:10:19.501 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:19 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-17T01:10:19.501 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:19 smithi071 systemd[1]: Stopped Ceph osd.2 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:10:19.501 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:19 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.2.service: Consumed 7.995s CPU time. 2024-09-17T01:10:19.816 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:19 smithi071 systemd[1]: Starting Ceph osd.2 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: pgmap v152: 161 pgs: 15 stale+active+clean, 146 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.3", "id": [5, 2]}]': finished 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.b", "id": [0, 6]}]': finished 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]': finished 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3]}]': finished 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]': finished 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 2]}]': finished 2024-09-17T01:10:19.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 2]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [7, 2]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[96259]: osdmap e140: 8 total, 7 up, 8 in 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: pgmap v152: 161 pgs: 15 stale+active+clean, 146 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.3", "id": [5, 2]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.b", "id": [0, 6]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 2]}]': finished 2024-09-17T01:10:19.818 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 2]}]': finished 2024-09-17T01:10:19.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [7, 2]}]': finished 2024-09-17T01:10:19.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]': finished 2024-09-17T01:10:19.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]': finished 2024-09-17T01:10:19.819 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:19 smithi071 ceph-mon[105664]: osdmap e140: 8 total, 7 up, 8 in 2024-09-17T01:10:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: pgmap v152: 161 pgs: 15 stale+active+clean, 146 active+clean; 585 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:10:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.3", "id": [5, 2]}]': finished 2024-09-17T01:10:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.b", "id": [0, 6]}]': finished 2024-09-17T01:10:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]': finished 2024-09-17T01:10:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3]}]': finished 2024-09-17T01:10:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]': finished 2024-09-17T01:10:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 2]}]': finished 2024-09-17T01:10:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 2]}]': finished 2024-09-17T01:10:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [7, 2]}]': finished 2024-09-17T01:10:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]': finished 2024-09-17T01:10:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]': finished 2024-09-17T01:10:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:19 smithi135 ceph-mon[89112]: osdmap e140: 8 total, 7 up, 8 in 2024-09-17T01:10:20.079 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:19 smithi071 podman[135385]: 2024-09-17 01:10:19.722277919 +0000 UTC m=+0.015837221 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:10:20.079 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:19 smithi071 podman[135385]: 2024-09-17 01:10:19.839220945 +0000 UTC m=+0.132780245 container create e01d7a478f75c2e001728b45e0f9e9dfe0266668ddbbf47cefadffd720ffaf80 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:10:21.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:21.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-mon[96259]: osdmap e141: 8 total, 7 up, 8 in 2024-09-17T01:10:21.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-mon[96259]: pgmap v155: 161 pgs: 30 active+undersized, 2 stale+active+clean, 11 active+undersized+degraded, 118 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 42/726 objects degraded (5.785%) 2024-09-17T01:10:21.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:21.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-mon[105664]: osdmap e141: 8 total, 7 up, 8 in 2024-09-17T01:10:21.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-mon[105664]: pgmap v155: 161 pgs: 30 active+undersized, 2 stale+active+clean, 11 active+undersized+degraded, 118 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 42/726 objects degraded (5.785%) 2024-09-17T01:10:21.147 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:20 smithi071 podman[135385]: 2024-09-17 01:10:20.729380369 +0000 UTC m=+1.022939675 container init e01d7a478f75c2e001728b45e0f9e9dfe0266668ddbbf47cefadffd720ffaf80 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux ) 2024-09-17T01:10:21.147 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:20 smithi071 podman[135385]: 2024-09-17 01:10:20.732823256 +0000 UTC m=+1.026382558 container start e01d7a478f75c2e001728b45e0f9e9dfe0266668ddbbf47cefadffd720ffaf80 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:10:21.147 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:20 smithi071 podman[135385]: 2024-09-17 01:10:20.804633349 +0000 UTC m=+1.098192660 container attach e01d7a478f75c2e001728b45e0f9e9dfe0266668ddbbf47cefadffd720ffaf80 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:10:21.147 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:21.147 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:20 smithi071 bash[135385]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:21.147 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:20 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:21.147 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:20 smithi071 bash[135385]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:20 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:20 smithi135 ceph-mon[89112]: osdmap e141: 8 total, 7 up, 8 in 2024-09-17T01:10:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:20 smithi135 ceph-mon[89112]: pgmap v155: 161 pgs: 30 active+undersized, 2 stale+active+clean, 11 active+undersized+degraded, 118 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 42/726 objects degraded (5.785%) 2024-09-17T01:10:21.896 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:10:21.896 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 bash[135385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:10:21.897 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:10:21.897 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 bash[135385]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:10:22.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-mon[105664]: osdmap e142: 8 total, 7 up, 8 in 2024-09-17T01:10:22.257 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 42/726 objects degraded (5.785%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:22.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-mon[96259]: osdmap e142: 8 total, 7 up, 8 in 2024-09-17T01:10:22.258 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 42/726 objects degraded (5.785%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:22.258 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:10:22.258 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 bash[135385]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:10:22.258 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:10:22.258 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 bash[135385]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:10:22.258 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:10:22.258 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 bash[135385]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:10:22.259 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:10:22.259 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 bash[135385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:10:22.259 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate[135412]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:10:22.259 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 bash[135385]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:10:22.259 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:21 smithi071 podman[135385]: 2024-09-17 01:10:21.962167213 +0000 UTC m=+2.255726515 container died e01d7a478f75c2e001728b45e0f9e9dfe0266668ddbbf47cefadffd720ffaf80 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:10:22.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:21 smithi135 ceph-mon[89112]: osdmap e142: 8 total, 7 up, 8 in 2024-09-17T01:10:22.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:21 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 42/726 objects degraded (5.785%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:22.772 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:22 smithi071 podman[135575]: 2024-09-17 01:10:22.569758181 +0000 UTC m=+0.598005960 container remove e01d7a478f75c2e001728b45e0f9e9dfe0266668ddbbf47cefadffd720ffaf80 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:10:23.024 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:22 smithi071 ceph-mon[96259]: pgmap v157: 161 pgs: 33 active+undersized, 15 active+undersized+degraded, 113 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s; 66/726 objects degraded (9.091%) 2024-09-17T01:10:23.024 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:22 smithi071 ceph-mon[105664]: pgmap v157: 161 pgs: 33 active+undersized, 15 active+undersized+degraded, 113 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s; 66/726 objects degraded (9.091%) 2024-09-17T01:10:23.025 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:22 smithi071 podman[135638]: 2024-09-17 01:10:22.678778781 +0000 UTC m=+0.016197264 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:10:23.025 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:22 smithi071 podman[135638]: 2024-09-17 01:10:22.795568326 +0000 UTC m=+0.132986796 container create dc6f9ff13a890438c0d698192df394590fb7b4a59988f2b9d6252e490777f2cd (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T01:10:23.025 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:23 smithi071 podman[135638]: 2024-09-17 01:10:23.023657036 +0000 UTC m=+0.361075511 container init dc6f9ff13a890438c0d698192df394590fb7b4a59988f2b9d6252e490777f2cd (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:10:23.025 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:23 smithi071 podman[135638]: 2024-09-17 01:10:23.026992214 +0000 UTC m=+0.364410684 container start dc6f9ff13a890438c0d698192df394590fb7b4a59988f2b9d6252e490777f2cd (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-17T01:10:23.356 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:23 smithi071 ceph-osd[135657]: -- 172.21.15.71:0/2231234309 <== mon.0 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56093b851a40 con 0x56093c618400 2024-09-17T01:10:23.356 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:23 smithi071 bash[135638]: dc6f9ff13a890438c0d698192df394590fb7b4a59988f2b9d6252e490777f2cd 2024-09-17T01:10:23.356 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:23 smithi071 systemd[1]: Started Ceph osd.2 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:10:23.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:22 smithi135 ceph-mon[89112]: pgmap v157: 161 pgs: 33 active+undersized, 15 active+undersized+degraded, 113 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s; 66/726 objects degraded (9.091%) 2024-09-17T01:10:24.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:24.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.146 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:24 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[135653]: 2024-09-17T01:10:24.668+0000 7f3f190e9640 -1 Falling back to public interface 2024-09-17T01:10:25.446 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.446 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.446 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.446 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.446 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.446 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.446 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.447 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: pgmap v158: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:25.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.448 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.449 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: pgmap v158: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.450 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.451 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.452 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.453 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.454 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.455 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.455 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.455 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.455 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.455 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: pgmap v158: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.522 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.523 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.524 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.525 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.527 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.527 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.527 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.528 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.528 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.528 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.528 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.528 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.528 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.529 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:26.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:26.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:26.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:26.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:26.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.190 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:10:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:10:26] "GET /metrics HTTP/1.1" 200 38443 "" "Prometheus/2.43.0" 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.445 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: pgmap v159: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 581 B/s rd, 0 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.446 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.447 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.448 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.526 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.527 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.528 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.529 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: pgmap v159: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 581 B/s rd, 0 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:27.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.530 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.531 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.531 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.532 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.532 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.532 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.532 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.532 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.532 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.533 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.533 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.533 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.533 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.533 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.533 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.534 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: pgmap v159: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 581 B/s rd, 0 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:27.535 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.536 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.537 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.538 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.539 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.540 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.540 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.540 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.540 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.540 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.540 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:27.541 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.541 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:27.541 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:27.541 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:27.541 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.470 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.470 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.470 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.470 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.470 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.646 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[135653]: 2024-09-17T01:10:28.222+0000 7f3f190e9640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-17T01:10:28.646 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[135653]: 2024-09-17T01:10:28.253+0000 7f3f190e9640 -1 osd.2 137 log_to_monitors true 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:28.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:28.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:28.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:28.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: pgmap v160: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 481 B/s rd, 0 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.212 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.213 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.214 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.215 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.396 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[135653]: 2024-09-17T01:10:29.252+0000 7f3f10e94640 -1 osd.2 137 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:10:29.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:10:29.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: pgmap v160: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 481 B/s rd, 0 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: pgmap v160: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 481 B/s rd, 0 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:29.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:29.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:29.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:29.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:29.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: osdmap e143: 8 total, 7 up, 8 in 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: osdmap e143: 8 total, 7 up, 8 in 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:10:30.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 66/726 objects degraded (9.091%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 66/726 objects degraded (9.091%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: osdmap e143: 8 total, 7 up, 8 in 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 66/726 objects degraded (9.091%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:30.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:30.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:30.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:30.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:30.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860] boot 2024-09-17T01:10:31.480 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: osdmap e144: 8 total, 8 up, 8 in 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.481 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: pgmap v163: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:31.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.483 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860] boot 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: osdmap e144: 8 total, 8 up, 8 in 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.484 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.485 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.485 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.485 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.485 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.485 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.485 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: pgmap v163: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.486 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.488 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.489 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[105664]: osdmap e145: 8 total, 8 up, 8 in 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.490 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.492 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:31 smithi071 ceph-mon[96259]: osdmap e145: 8 total, 8 up, 8 in 2024-09-17T01:10:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: osd.2 [v2:172.21.15.71:6816/786156860,v1:172.21.15.71:6817/786156860] boot 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: osdmap e144: 8 total, 8 up, 8 in 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: pgmap v163: 161 pgs: 9 active+clean+remapped, 31 active+undersized, 15 active+undersized+degraded, 106 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 66/726 objects degraded (9.091%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:31.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:31.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:31.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:31.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:31.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:31 smithi135 ceph-mon[89112]: osdmap e145: 8 total, 8 up, 8 in 2024-09-17T01:10:32.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[96259]: osdmap e146: 8 total, 8 up, 8 in 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:32 smithi071 ceph-mon[105664]: osdmap e146: 8 total, 8 up, 8 in 2024-09-17T01:10:32.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:32.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:32.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:32 smithi135 ceph-mon[89112]: osdmap e146: 8 total, 8 up, 8 in 2024-09-17T01:10:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: pgmap v166: 161 pgs: 5 activating, 9 active+clean+remapped, 28 active+undersized, 13 active+undersized+degraded, 106 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 44/726 objects degraded (6.061%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: pgmap v166: 161 pgs: 5 activating, 9 active+clean+remapped, 28 active+undersized, 13 active+undersized+degraded, 106 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 44/726 objects degraded (6.061%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.659 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.660 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: pgmap v166: 161 pgs: 5 activating, 9 active+clean+remapped, 28 active+undersized, 13 active+undersized+degraded, 106 active+clean; 585 KiB data, 185 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 44/726 objects degraded (6.061%); 1/726 objects misplaced (0.138%) 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:33.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.629 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.630 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.631 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.632 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.634 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.635 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.635 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.635 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.635 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.635 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.636 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.637 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.638 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.638 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: pgmap v167: 161 pgs: 5 activating, 156 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: pgmap v167: 161 pgs: 5 activating, 156 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 44/726 objects degraded (6.061%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 44/726 objects degraded (6.061%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.658 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: pgmap v167: 161 pgs: 5 activating, 156 active+clean; 585 KiB data, 186 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 44/726 objects degraded (6.061%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:35.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/726 objects degraded (6.061%), 13 pgs degraded) 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/726 objects degraded (6.061%), 13 pgs degraded) 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/726 objects degraded (6.061%), 13 pgs degraded) 2024-09-17T01:10:36.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:10:36.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:36.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.716 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.717 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.718 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.718 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.718 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.718 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.718 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.718 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:36.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:36.719 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.720 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:36.720 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:36.720 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:10:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:10:36] "GET /metrics HTTP/1.1" 200 38460 "" "Prometheus/2.43.0" 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:37.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:37.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:38.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:38.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:38.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: Upgrade: osd.3 is safe to restart 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:38.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: Upgrade: osd.3 is safe to restart 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:38.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: Upgrade: osd.3 is safe to restart 2024-09-17T01:10:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:38.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:39.445 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:39 smithi071 ceph-mon[96259]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:39.445 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:39 smithi071 ceph-mon[105664]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:39.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:39 smithi135 ceph-mon[89112]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:41.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[96259]: Upgrade: Updating osd.3 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[96259]: Deploying daemon osd.3 on smithi071 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[96259]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[105664]: Upgrade: Updating osd.3 2024-09-17T01:10:41.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:41.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:10:41.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:41.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[105664]: Deploying daemon osd.3 on smithi071 2024-09-17T01:10:41.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:41 smithi071 ceph-mon[105664]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:41 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:41 smithi135 ceph-mon[89112]: Upgrade: Updating osd.3 2024-09-17T01:10:41.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:10:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:41 smithi135 ceph-mon[89112]: Deploying daemon osd.3 on smithi071 2024-09-17T01:10:41.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:41 smithi135 ceph-mon[89112]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:42.770 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 5s ago 18m - - 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 11s ago 17m - - 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (7m) 5s ago 13m 25.3M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (7m) 11s ago 12m 54.4M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (5m) 5s ago 11m 59.3M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (6m) 11s ago 17m 517M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:10:43.444 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (4m) 5s ago 18m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (4m) 5s ago 18m 60.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (3m) 11s ago 17m 41.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (3m) 5s ago 17m 51.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (7m) 5s ago 13m 15.6M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (7m) 11s ago 13m 16.0M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (111s) 5s ago 16m 51.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (59s) 5s ago 16m 53.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (20s) 5s ago 16m 42.6M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (15m) 5s ago 15m 65.0M 4096M 17.2.0 e1d6a67b021e 86eefd9d0292 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (15m) 11s ago 15m 63.7M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (15m) 11s ago 15m 59.0M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (14m) 11s ago 14m 58.1M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (14m) 11s ago 14m 63.3M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:10:43.446 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (6m) 11s ago 13m 62.5M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:10:43.446 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (11m) 5s ago 11m 76.9M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:10:43.446 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (11m) 11s ago 11m 75.2M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:10:43.446 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (11m) 5s ago 11m 75.4M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:10:43.446 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (11m) 11s ago 11m 75.6M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:10:43.849 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:10:43.849 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:10:43.849 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 9, 2024-09-17T01:10:43.850 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:10:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:10:43.851 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:10:43.851 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:43 smithi071 ceph-mon[96259]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 999 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:43.851 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:43.851 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:43 smithi071 ceph-mon[105664]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 999 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:43.851 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:43 smithi135 ceph-mon[89112]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 999 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:44.195 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:10:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:10:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:10:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:10:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:10:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:10:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:10:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:10:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T01:10:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:10:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:10:44.196 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:10:44.603 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:10:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:44 smithi135 ceph-mon[89112]: from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:44 smithi135 ceph-mon[89112]: from='client.64354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:44 smithi135 ceph-mon[89112]: from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:44 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/646412888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[105664]: from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[105664]: from='client.64354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[105664]: from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/646412888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[96259]: from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[96259]: from='client.64354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[96259]: from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:44.839 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:44 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/646412888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:45.826 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:45 smithi071 ceph-mon[105664]: from='client.64372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:45.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:45 smithi071 ceph-mon[105664]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:45.827 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:45 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2744622394' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:45.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:45 smithi071 ceph-mon[96259]: from='client.64372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:45.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:45 smithi071 ceph-mon[96259]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:45.827 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:45 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2744622394' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:45 smithi135 ceph-mon[89112]: from='client.64372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:45 smithi135 ceph-mon[89112]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-17T01:10:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:45 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2744622394' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:46.432 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:46 smithi071 systemd[1]: Stopping Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:10:46.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:46 smithi071 ceph-mon[105664]: osd.3 marked itself down and dead 2024-09-17T01:10:46.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:46 smithi071 ceph-mon[96259]: osd.3 marked itself down and dead 2024-09-17T01:10:46.896 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[40713]: 2024-09-17T01:10:46.433+0000 7f7925c67700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:10:46.897 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[40713]: 2024-09-17T01:10:46.433+0000 7f7925c67700 -1 osd.3 146 *** Got signal Terminated *** 2024-09-17T01:10:46.897 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:46 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[40713]: 2024-09-17T01:10:46.433+0000 7f7925c67700 -1 osd.3 146 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:10:46.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:46 smithi135 ceph-mon[89112]: osd.3 marked itself down and dead 2024-09-17T01:10:46.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:10:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:10:46] "GET /metrics HTTP/1.1" 200 38460 "" "Prometheus/2.43.0" 2024-09-17T01:10:47.349 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:46 smithi071 podman[141927]: 2024-09-17 01:10:46.914447343 +0000 UTC m=+0.588498453 container died 86eefd9d0292a145f1c1f176f055e642502f0d242d499447050f7c2aeb32963d (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, release=754, io.openshift.expose-services=, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, ceph=True, name=centos-stream, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8) 2024-09-17T01:10:47.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:47 smithi071 ceph-mon[105664]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:47.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:47 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:47.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:47 smithi071 ceph-mon[105664]: osdmap e147: 8 total, 7 up, 8 in 2024-09-17T01:10:47.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:47 smithi071 ceph-mon[96259]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:47.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:47 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:47.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:47 smithi071 ceph-mon[96259]: osdmap e147: 8 total, 7 up, 8 in 2024-09-17T01:10:47.648 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:47 smithi071 podman[141927]: 2024-09-17 01:10:47.567290459 +0000 UTC m=+1.241341562 container cleanup 86eefd9d0292a145f1c1f176f055e642502f0d242d499447050f7c2aeb32963d (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, version=8, name=centos-stream, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, release=754, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8) 2024-09-17T01:10:47.648 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:47 smithi071 bash[141927]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:10:47.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:47 smithi135 ceph-mon[89112]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:10:47.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:47 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:10:47.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:47 smithi135 ceph-mon[89112]: osdmap e147: 8 total, 7 up, 8 in 2024-09-17T01:10:48.226 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:47 smithi071 podman[141942]: 2024-09-17 01:10:47.902129251 +0000 UTC m=+0.987262819 container remove 86eefd9d0292a145f1c1f176f055e642502f0d242d499447050f7c2aeb32963d (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , distribution-scope=public, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, release=754, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, version=8, vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-09-17T01:10:48.495 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:48 smithi071 podman[142032]: 2024-09-17 01:10:48.131595667 +0000 UTC m=+0.015731875 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:10:48.495 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:48 smithi071 podman[142032]: 2024-09-17 01:10:48.236232354 +0000 UTC m=+0.120368543 container create 2a514804a9b4416969c999c84bffbbcba89617c32039c8f2f072b05eca3f1396 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:10:48.834 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:48 smithi135 ceph-mon[89112]: osdmap e148: 8 total, 7 up, 8 in 2024-09-17T01:10:48.834 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:48.835 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:48 smithi071 ceph-mon[105664]: osdmap e148: 8 total, 7 up, 8 in 2024-09-17T01:10:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:48 smithi071 ceph-mon[96259]: osdmap e148: 8 total, 7 up, 8 in 2024-09-17T01:10:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:48.897 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:48 smithi071 podman[142032]: 2024-09-17 01:10:48.497686234 +0000 UTC m=+0.381822439 container init 2a514804a9b4416969c999c84bffbbcba89617c32039c8f2f072b05eca3f1396 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:10:48.897 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:48 smithi071 podman[142032]: 2024-09-17 01:10:48.501678334 +0000 UTC m=+0.385814532 container start 2a514804a9b4416969c999c84bffbbcba89617c32039c8f2f072b05eca3f1396 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0) 2024-09-17T01:10:48.897 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:48 smithi071 podman[142032]: 2024-09-17 01:10:48.572449135 +0000 UTC m=+0.456585339 container attach 2a514804a9b4416969c999c84bffbbcba89617c32039c8f2f072b05eca3f1396 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T01:10:48.898 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:48 smithi071 podman[142032]: 2024-09-17 01:10:48.702672449 +0000 UTC m=+0.586808654 container died 2a514804a9b4416969c999c84bffbbcba89617c32039c8f2f072b05eca3f1396 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T01:10:49.854 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:49 smithi071 ceph-mon[96259]: pgmap v176: 161 pgs: 25 stale+active+clean, 136 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:10:49.855 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:49 smithi071 ceph-mon[105664]: pgmap v176: 161 pgs: 25 stale+active+clean, 136 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:10:49.855 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:49 smithi071 podman[142054]: 2024-09-17 01:10:49.418117675 +0000 UTC m=+0.709838263 container remove 2a514804a9b4416969c999c84bffbbcba89617c32039c8f2f072b05eca3f1396 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T01:10:49.855 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:49 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T01:10:49.855 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:49 smithi071 systemd[1]: Stopped Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:10:49.856 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:49 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.3.service: Consumed 11.055s CPU time. 2024-09-17T01:10:49.856 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:49 smithi071 systemd[1]: Starting Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:10:49.900 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:49 smithi135 ceph-mon[89112]: pgmap v176: 161 pgs: 25 stale+active+clean, 136 active+clean; 585 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:10:50.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:49 smithi071 podman[142153]: 2024-09-17 01:10:49.759944647 +0000 UTC m=+0.016364715 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:10:50.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:49 smithi071 podman[142153]: 2024-09-17 01:10:49.902361552 +0000 UTC m=+0.158781620 container create 1da9e65ae74ab4edf7809ee6cbf241535d90db43b9324c8adccac6f359938cef (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T01:10:50.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 podman[142153]: 2024-09-17 01:10:50.096997208 +0000 UTC m=+0.353417281 container init 1da9e65ae74ab4edf7809ee6cbf241535d90db43b9324c8adccac6f359938cef (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T01:10:50.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 podman[142153]: 2024-09-17 01:10:50.100497427 +0000 UTC m=+0.356917501 container start 1da9e65ae74ab4edf7809ee6cbf241535d90db43b9324c8adccac6f359938cef (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-17T01:10:50.619 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 podman[142153]: 2024-09-17 01:10:50.172081913 +0000 UTC m=+0.428501999 container attach 1da9e65ae74ab4edf7809ee6cbf241535d90db43b9324c8adccac6f359938cef (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97) 2024-09-17T01:10:50.619 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:50.619 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:50.619 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:50.619 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:10:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-mon[96259]: pgmap v177: 161 pgs: 34 active+undersized, 6 stale+active+clean, 19 active+undersized+degraded, 102 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 69/726 objects degraded (9.504%) 2024-09-17T01:10:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 69/726 objects degraded (9.504%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-mon[105664]: pgmap v177: 161 pgs: 34 active+undersized, 6 stale+active+clean, 19 active+undersized+degraded, 102 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 69/726 objects degraded (9.504%) 2024-09-17T01:10:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 69/726 objects degraded (9.504%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:50.898 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:10:50.898 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:10:50.898 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:10:50.898 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:10:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:50 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:10:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:50 smithi135 ceph-mon[89112]: pgmap v177: 161 pgs: 34 active+undersized, 6 stale+active+clean, 19 active+undersized+degraded, 102 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 69/726 objects degraded (9.504%) 2024-09-17T01:10:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:50 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 69/726 objects degraded (9.504%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:10:51.247 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:10:51.247 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:10:51.247 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:10:51.247 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:10:51.248 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:10:51.248 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:10:51.248 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:10:51.248 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:10:51.248 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[142167]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:10:51.248 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:50 smithi071 bash[142153]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:10:51.248 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:51 smithi071 podman[142153]: 2024-09-17 01:10:51.010548476 +0000 UTC m=+1.266968550 container died 1da9e65ae74ab4edf7809ee6cbf241535d90db43b9324c8adccac6f359938cef (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:10:52.081 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:51 smithi071 podman[142312]: 2024-09-17 01:10:51.767673956 +0000 UTC m=+0.751325812 container remove 1da9e65ae74ab4edf7809ee6cbf241535d90db43b9324c8adccac6f359938cef (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:10:52.081 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:51 smithi071 podman[142380]: 2024-09-17 01:10:51.976914291 +0000 UTC m=+0.113079395 container create 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T01:10:52.081 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:51 smithi071 podman[142380]: 2024-09-17 01:10:51.88792198 +0000 UTC m=+0.024087093 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:10:52.520 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:52 smithi071 podman[142380]: 2024-09-17 01:10:52.196351273 +0000 UTC m=+0.332516382 container init 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD) 2024-09-17T01:10:52.520 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:52 smithi071 podman[142380]: 2024-09-17 01:10:52.200487849 +0000 UTC m=+0.336652963 container start 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T01:10:52.520 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:52 smithi071 ceph-osd[142399]: -- 172.21.15.71:0/270282376 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5627fb091a40 con 0x5627fbe58400 2024-09-17T01:10:52.520 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:52 smithi071 bash[142380]: 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 2024-09-17T01:10:52.520 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:52 smithi071 systemd[1]: Started Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:10:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:53.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: pgmap v178: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: pgmap v178: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: pgmap v178: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:53.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:53.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:53 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[142395]: 2024-09-17T01:10:53.858+0000 7f133ba83640 -1 Falling back to public interface 2024-09-17T01:10:54.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.148 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.150 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.151 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.153 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:54.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:54.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:54.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:54.469 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:54.470 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:54.470 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: pgmap v179: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: pgmap v179: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: pgmap v179: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:55.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.037 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:10:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:10:56] "GET /metrics HTTP/1.1" 200 38456 "" "Prometheus/2.43.0" 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.148 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.149 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: pgmap v180: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:57.149 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.150 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.151 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: pgmap v180: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.152 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.153 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.154 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.154 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.156 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.157 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: pgmap v180: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:57.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:57.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:57.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:57.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:57.683 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[142395]: 2024-09-17T01:10:57.422+0000 7f133ba83640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-17T01:10:57.683 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:57 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[142395]: 2024-09-17T01:10:57.459+0000 7f133ba83640 -1 osd.3 146 log_to_monitors true 2024-09-17T01:10:58.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.042 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:10:58 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[142395]: 2024-09-17T01:10:58.888+0000 7f132f826640 -1 osd.3 146 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:10:59.377 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.377 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:59.378 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: Upgrade: osd.3 is safe to restart 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:10:59.379 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: osdmap e149: 8 total, 7 up, 8 in 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:59.380 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.381 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: Upgrade: osd.3 is safe to restart 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: osdmap e149: 8 total, 7 up, 8 in 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: pgmap v182: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[105664]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: pgmap v182: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:59.382 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:10:59 smithi071 ceph-mon[96259]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' 2024-09-17T01:10:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: Upgrade: osd.3 is safe to restart 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: osdmap e149: 8 total, 7 up, 8 in 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:10:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: pgmap v182: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 191 MiB used, 715 GiB / 715 GiB avail; 94/726 objects degraded (12.948%) 2024-09-17T01:10:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:10:59 smithi135 ceph-mon[89112]: from='osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525]' entity='osd.3' 2024-09-17T01:11:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[105664]: osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525] boot 2024-09-17T01:11:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[105664]: osdmap e150: 8 total, 8 up, 8 in 2024-09-17T01:11:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:11:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[96259]: osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525] boot 2024-09-17T01:11:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[96259]: osdmap e150: 8 total, 8 up, 8 in 2024-09-17T01:11:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:11:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:00 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:00 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:00 smithi135 ceph-mon[89112]: osd.3 [v2:172.21.15.71:6824/2843216525,v1:172.21.15.71:6825/2843216525] boot 2024-09-17T01:11:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:00 smithi135 ceph-mon[89112]: osdmap e150: 8 total, 8 up, 8 in 2024-09-17T01:11:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:11:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:00 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:01.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:01.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[105664]: pgmap v184: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:01.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[105664]: osdmap e151: 8 total, 8 up, 8 in 2024-09-17T01:11:01.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:11:01.697 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:01.697 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:01.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[96259]: pgmap v184: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:01.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[96259]: osdmap e151: 8 total, 8 up, 8 in 2024-09-17T01:11:01.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:11:01.698 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:01 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:01 smithi135 ceph-mon[89112]: pgmap v184: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:01 smithi135 ceph-mon[89112]: osdmap e151: 8 total, 8 up, 8 in 2024-09-17T01:11:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:11:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:02.549 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:02 smithi071 ceph-mon[96259]: Upgrade: Updating osd.3 2024-09-17T01:11:02.549 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:02 smithi071 ceph-mon[96259]: Deploying daemon osd.3 on smithi071 2024-09-17T01:11:02.549 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:02 smithi071 ceph-mon[105664]: Upgrade: Updating osd.3 2024-09-17T01:11:02.549 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:02 smithi071 ceph-mon[105664]: Deploying daemon osd.3 on smithi071 2024-09-17T01:11:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:02 smithi135 ceph-mon[89112]: Upgrade: Updating osd.3 2024-09-17T01:11:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:02 smithi135 ceph-mon[89112]: Deploying daemon osd.3 on smithi071 2024-09-17T01:11:03.516 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:03 smithi071 ceph-mon[105664]: pgmap v186: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/726 objects degraded (10.882%) 2024-09-17T01:11:03.517 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:03.517 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:03.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:03 smithi071 ceph-mon[96259]: pgmap v186: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/726 objects degraded (10.882%) 2024-09-17T01:11:03.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:03.517 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:03 smithi135 ceph-mon[89112]: pgmap v186: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/726 objects degraded (10.882%) 2024-09-17T01:11:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:03.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:04 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 79/726 objects degraded (10.882%), 21 pgs degraded) 2024-09-17T01:11:04.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:04 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:11:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:04 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 79/726 objects degraded (10.882%), 21 pgs degraded) 2024-09-17T01:11:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:04 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:11:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:04 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 79/726 objects degraded (10.882%), 21 pgs degraded) 2024-09-17T01:11:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:04 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:11:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[96259]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[105664]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:05.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:05 smithi135 ceph-mon[89112]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[105664]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:06.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:06 smithi071 ceph-mon[96259]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:06.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:06.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:06 smithi135 ceph-mon[89112]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:06.961 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:11:06] "GET /metrics HTTP/1.1" 200 38324 "" "Prometheus/2.43.0" 2024-09-17T01:11:08.469 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:08 smithi071 systemd[1]: Stopping Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:11:08.469 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:08 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[142395]: 2024-09-17T01:11:08.408+0000 7f1338a1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:11:08.469 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:08 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[142395]: 2024-09-17T01:11:08.408+0000 7f1338a1b640 -1 osd.3 151 *** Got signal Terminated *** 2024-09-17T01:11:08.469 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:08 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[142395]: 2024-09-17T01:11:08.408+0000 7f1338a1b640 -1 osd.3 151 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:11:08.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:08 smithi135 ceph-mon[89112]: osd.3 marked itself down and dead 2024-09-17T01:11:08.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:08 smithi071 ceph-mon[96259]: osd.3 marked itself down and dead 2024-09-17T01:11:08.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:08 smithi071 ceph-mon[105664]: osd.3 marked itself down and dead 2024-09-17T01:11:09.249 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:08 smithi071 podman[145962]: 2024-09-17 01:11:08.961212072 +0000 UTC m=+0.646716510 container stop 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:11:09.249 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:08 smithi071 podman[145962]: 2024-09-17 01:11:08.986837663 +0000 UTC m=+0.672342085 container died 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T01:11:09.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:09.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[96259]: osdmap e152: 8 total, 7 up, 8 in 2024-09-17T01:11:09.625 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[96259]: pgmap v190: 161 pgs: 25 stale+active+clean, 136 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:09.626 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[96259]: osdmap e153: 8 total, 7 up, 8 in 2024-09-17T01:11:09.626 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:09.626 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[105664]: osdmap e152: 8 total, 7 up, 8 in 2024-09-17T01:11:09.626 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[105664]: pgmap v190: 161 pgs: 25 stale+active+clean, 136 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:09.626 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:09 smithi071 ceph-mon[105664]: osdmap e153: 8 total, 7 up, 8 in 2024-09-17T01:11:09.626 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:09 smithi071 podman[145962]: 2024-09-17 01:11:09.45170603 +0000 UTC m=+1.137210452 container cleanup 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731) 2024-09-17T01:11:09.626 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:09 smithi071 bash[145962]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:11:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:09 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:09 smithi135 ceph-mon[89112]: osdmap e152: 8 total, 7 up, 8 in 2024-09-17T01:11:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:09 smithi135 ceph-mon[89112]: pgmap v190: 161 pgs: 25 stale+active+clean, 136 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:09.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:09 smithi135 ceph-mon[89112]: osdmap e153: 8 total, 7 up, 8 in 2024-09-17T01:11:09.896 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:09 smithi071 podman[145979]: 2024-09-17 01:11:09.65771089 +0000 UTC m=+0.689749227 container remove 15d4f0ff56606a1033cc6bd36d8f62b608b10e3a27b3f953804c15ca1f5fa9e3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:11:10.321 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:10 smithi071 podman[146066]: 2024-09-17 01:11:09.970881602 +0000 UTC m=+0.016123097 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:11:10.322 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:10 smithi071 podman[146066]: 2024-09-17 01:11:10.096535493 +0000 UTC m=+0.141777013 container create 2ac16e7727952c3bdc1d5437d9aeaf0ec347046ad0e0c699766a53c059ea5ede (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:11:10.593 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:10 smithi071 podman[146066]: 2024-09-17 01:11:10.324357192 +0000 UTC m=+0.369598677 container init 2ac16e7727952c3bdc1d5437d9aeaf0ec347046ad0e0c699766a53c059ea5ede (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-17T01:11:10.593 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:10 smithi071 podman[146066]: 2024-09-17 01:11:10.32786324 +0000 UTC m=+0.373104722 container start 2ac16e7727952c3bdc1d5437d9aeaf0ec347046ad0e0c699766a53c059ea5ede (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-17T01:11:10.593 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:10 smithi071 podman[146066]: 2024-09-17 01:11:10.398887635 +0000 UTC m=+0.444129126 container attach 2ac16e7727952c3bdc1d5437d9aeaf0ec347046ad0e0c699766a53c059ea5ede (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97) 2024-09-17T01:11:10.593 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:10 smithi071 podman[146066]: 2024-09-17 01:11:10.52320443 +0000 UTC m=+0.568445923 container died 2ac16e7727952c3bdc1d5437d9aeaf0ec347046ad0e0c699766a53c059ea5ede (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T01:11:10.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:10 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:10.796 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:10 smithi135 ceph-mon[89112]: pgmap v192: 161 pgs: 48 peering, 11 stale+active+clean, 102 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:10.796 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:10 smithi135 ceph-mon[89112]: Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2024-09-17T01:11:10.849 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:10 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:10.849 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:10 smithi071 ceph-mon[105664]: pgmap v192: 161 pgs: 48 peering, 11 stale+active+clean, 102 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:10.849 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:10 smithi071 ceph-mon[105664]: Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2024-09-17T01:11:10.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:10 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:10.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:10 smithi071 ceph-mon[96259]: pgmap v192: 161 pgs: 48 peering, 11 stale+active+clean, 102 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:10.850 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:10 smithi071 ceph-mon[96259]: Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2024-09-17T01:11:11.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 podman[146090]: 2024-09-17 01:11:11.220224524 +0000 UTC m=+0.691157404 container remove 2ac16e7727952c3bdc1d5437d9aeaf0ec347046ad0e0c699766a53c059ea5ede (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:11:11.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T01:11:11.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 systemd[1]: Stopped Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:11:11.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.3.service: Consumed 2.047s CPU time. 2024-09-17T01:11:11.647 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 systemd[1]: Starting Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:11:11.912 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 podman[146189]: 2024-09-17 01:11:11.564391196 +0000 UTC m=+0.016348827 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:11:11.912 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 podman[146189]: 2024-09-17 01:11:11.677062324 +0000 UTC m=+0.129019943 container create 1b251f0b67c88b4d088bcd75f8cd1a9ecf28ba1ccad6389eef70b57c1d8e09d8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-17T01:11:12.396 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 podman[146189]: 2024-09-17 01:11:11.915517846 +0000 UTC m=+0.367475469 container init 1b251f0b67c88b4d088bcd75f8cd1a9ecf28ba1ccad6389eef70b57c1d8e09d8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T01:11:12.396 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:11 smithi071 podman[146189]: 2024-09-17 01:11:11.918960191 +0000 UTC m=+0.370917812 container start 1b251f0b67c88b4d088bcd75f8cd1a9ecf28ba1ccad6389eef70b57c1d8e09d8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD) 2024-09-17T01:11:12.397 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 podman[146189]: 2024-09-17 01:11:12.007144918 +0000 UTC m=+0.459102546 container attach 1b251f0b67c88b4d088bcd75f8cd1a9ecf28ba1ccad6389eef70b57c1d8e09d8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:11:12.397 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:12.397 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:12.397 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:12.397 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:12.798 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:11:12.798 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:11:12.798 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:11:12.798 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:11:12.799 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:11:12.799 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:11:13.049 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:11:13.049 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:11:13.049 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:11:13.049 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:11:13.049 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:11:13.050 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:11:13.050 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate[146204]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:11:13.050 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 bash[146189]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:11:13.050 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:12 smithi071 podman[146189]: 2024-09-17 01:11:12.828877951 +0000 UTC m=+1.280835578 container died 1b251f0b67c88b4d088bcd75f8cd1a9ecf28ba1ccad6389eef70b57c1d8e09d8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[105664]: pgmap v193: 161 pgs: 7 active+undersized, 48 peering, 5 stale+active+clean, 5 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 25/726 objects degraded (3.444%) 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.367 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-mon[96259]: pgmap v193: 161 pgs: 7 active+undersized, 48 peering, 5 stale+active+clean, 5 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 25/726 objects degraded (3.444%) 2024-09-17T01:11:13.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:13.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:13 smithi135 ceph-mon[89112]: pgmap v193: 161 pgs: 7 active+undersized, 48 peering, 5 stale+active+clean, 5 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 25/726 objects degraded (3.444%) 2024-09-17T01:11:13.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:13 smithi071 podman[146338]: 2024-09-17 01:11:13.369598881 +0000 UTC m=+0.534965567 container remove 1b251f0b67c88b4d088bcd75f8cd1a9ecf28ba1ccad6389eef70b57c1d8e09d8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:11:13.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:13 smithi071 podman[146396]: 2024-09-17 01:11:13.477965069 +0000 UTC m=+0.016018221 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:11:13.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:13 smithi071 podman[146396]: 2024-09-17 01:11:13.600672201 +0000 UTC m=+0.138725325 container create 498b754b1a921469dd29676d6c8a9e4cfe80e76974f5f9596ab7907df8b10794 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:11:14.148 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:13 smithi071 podman[146396]: 2024-09-17 01:11:13.956640806 +0000 UTC m=+0.494693948 container init 498b754b1a921469dd29676d6c8a9e4cfe80e76974f5f9596ab7907df8b10794 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:11:14.148 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:13 smithi071 podman[146396]: 2024-09-17 01:11:13.959789071 +0000 UTC m=+0.497842206 container start 498b754b1a921469dd29676d6c8a9e4cfe80e76974f5f9596ab7907df8b10794 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:11:14.148 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:13 smithi071 ceph-osd[146415]: -- 172.21.15.71:0/176514016 <== mon.1 v2:172.21.15.71:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b9b83f5a40 con 0x55b9b91bc000 2024-09-17T01:11:14.148 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:14 smithi071 bash[146396]: 498b754b1a921469dd29676d6c8a9e4cfe80e76974f5f9596ab7907df8b10794 2024-09-17T01:11:14.148 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:14 smithi071 systemd[1]: Started Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:11:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:14 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 25/726 objects degraded (3.444%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:14.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 25/726 objects degraded (3.444%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:14.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 25/726 objects degraded (3.444%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:14.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:14.983 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:11:15.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.208 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.209 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: pgmap v194: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.210 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.211 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: pgmap v194: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.212 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.213 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.214 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.215 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.216 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.216 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.216 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: pgmap v194: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:15.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:15.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:15.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:15.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 10s ago 18m - - 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 3s ago 18m - - 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (8m) 10s ago 13m 25.4M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (7m) 3s ago 13m 54.5M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (6m) 10s ago 11m 59.5M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (6m) 3s ago 17m 520M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (5m) 10s ago 19m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (4m) 10s ago 19m 61.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (3m) 3s ago 18m 44.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:11:15.687 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (4m) 10s ago 18m 52.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (8m) 10s ago 13m 15.3M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (7m) 3s ago 13m 16.1M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (2m) 10s ago 17m 52.0M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (91s) 10s ago 17m 55.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (53s) 10s ago 16m 44.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 starting - - - 4096M 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (15m) 3s ago 15m 65.4M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (15m) 3s ago 15m 60.7M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (15m) 3s ago 15m 59.4M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (14m) 3s ago 14m 65.4M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (6m) 3s ago 14m 66.5M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (12m) 10s ago 12m 77.0M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:11:15.688 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (12m) 3s ago 12m 75.4M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:11:15.689 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (11m) 10s ago 11m 75.6M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:11:15.689 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (11m) 3s ago 11m 75.9M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:11:16.129 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:11:16.129 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:11:16.129 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:11:16.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8, 2024-09-17T01:11:16.132 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:11:16.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:11:16.133 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:11:16.133 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:15 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[146411]: 2024-09-17T01:11:15.872+0000 7f6ef19f1640 -1 Falling back to public interface 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='client.44427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='client.74273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 6 pgs peering) 2024-09-17T01:11:16.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='client.44427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='client.74273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 6 pgs peering) 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2969987416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:16 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2969987416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='client.44427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='client.74273 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs inactive, 6 pgs peering) 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:16.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:16.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:16.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:16.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2969987416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:11:16.497 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:11:16.498 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T01:11:16.498 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:11:16.498 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:11:16.498 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:11:16.917 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded 2024-09-17T01:11:16.917 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:11:16.917 INFO:teuthology.orchestra.run.smithi071.stdout: osd.3 (root=default,host=smithi071) is down 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.9 is active+undersized+degraded, acting [1,7] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.12 is active+undersized+degraded, acting [5,7] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.14 is active+undersized+degraded, acting [6,5] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1b is active+undersized+degraded, acting [7,6] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1 is active+undersized+degraded, acting [0,4] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.2 is active+undersized+degraded, acting [5,6] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.5 is active+undersized+degraded, acting [5,2] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.7 is active+undersized+degraded, acting [7,0] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.8 is active+undersized+degraded, acting [1,7] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.b is active+undersized+degraded, acting [0,4] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.c is active+undersized+degraded, acting [5,6] 2024-09-17T01:11:16.918 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.12 is active+undersized+degraded, acting [0,7] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.15 is active+undersized+degraded, acting [7,4] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.17 is active+undersized+degraded, acting [0,5] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.18 is active+undersized+degraded, acting [0,1] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.19 is active+undersized+degraded, acting [1,4] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1e is active+undersized+degraded, acting [6,2] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.0 is active+undersized+degraded, acting [7,0] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.9 is active+undersized+degraded, acting [4,1] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.14 is active+undersized+degraded, acting [1,7] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.15 is active+undersized+degraded, acting [5,7] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 5.1c is active+undersized+degraded, acting [4,2] 2024-09-17T01:11:16.919 INFO:teuthology.orchestra.run.smithi071.stdout: pg 6.c is active+undersized+degraded, acting [6,5] 2024-09-17T01:11:17.158 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:11:16] "GET /metrics HTTP/1.1" 200 38324 "" "Prometheus/2.43.0" 2024-09-17T01:11:17.188 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.188 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='client.44439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:17.188 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.188 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.189 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: pgmap v195: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.190 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='client.44439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.191 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.192 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: pgmap v195: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.193 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.194 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2341076833' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.196 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2341076833' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.197 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.198 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='client.44439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:17.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: pgmap v195: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2341076833' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:17.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:17.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:17.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:17.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:17.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:18.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.427 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[146411]: 2024-09-17T01:11:19.217+0000 7f6ef19f1640 -1 osd.3 151 log_to_monitors true 2024-09-17T01:11:19.427 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.427 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.428 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.429 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.430 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.430 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:19.430 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: pgmap v196: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:19.430 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.430 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.430 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.431 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: pgmap v196: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.433 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.434 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.435 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.436 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.437 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.438 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.438 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.438 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.438 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.438 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.438 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.438 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:19.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: pgmap v196: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:19.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:19.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:19.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:19.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:19.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:11:20.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:20.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.494 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[146411]: 2024-09-17T01:11:20.194+0000 7f6ee979c640 -1 osd.3 151 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:11:20.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.495 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.496 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.498 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.499 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:20.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.503 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.503 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.503 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.504 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.505 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.507 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.508 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 94/726 objects degraded (12.948%), 24 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:20.509 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: osdmap e154: 8 total, 7 up, 8 in 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: pgmap v198: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 202 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: osdmap e154: 8 total, 7 up, 8 in 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.492 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.493 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.494 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.494 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:21.494 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.494 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.494 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: osdmap e154: 8 total, 7 up, 8 in 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.495 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.496 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: pgmap v198: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 202 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.497 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.499 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: pgmap v198: 161 pgs: 41 active+undersized, 24 active+undersized+degraded, 96 active+clean; 585 KiB data, 202 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 94/726 objects degraded (12.948%) 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:21.500 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.501 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:21.502 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.329 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.329 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910] boot 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: osdmap e155: 8 total, 8 up, 8 in 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.330 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.331 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.333 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.334 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.334 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.334 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.334 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.334 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910] boot 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: osdmap e155: 8 total, 8 up, 8 in 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.335 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.336 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.337 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.338 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: osd.3 [v2:172.21.15.71:6824/3002154910,v1:172.21.15.71:6825/3002154910] boot 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: osdmap e155: 8 total, 8 up, 8 in 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:22.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:22.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:22.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.235 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: osdmap e156: 8 total, 8 up, 8 in 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.236 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: pgmap v201: 161 pgs: 6 peering, 38 active+undersized, 21 active+undersized+degraded, 96 active+clean; 585 KiB data, 202 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/726 objects degraded (10.882%) 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: osdmap e156: 8 total, 8 up, 8 in 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.238 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: pgmap v201: 161 pgs: 6 peering, 38 active+undersized, 21 active+undersized+degraded, 96 active+clean; 585 KiB data, 202 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/726 objects degraded (10.882%) 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.239 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.240 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.242 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.243 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.244 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: osdmap e156: 8 total, 8 up, 8 in 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: pgmap v201: 161 pgs: 6 peering, 38 active+undersized, 21 active+undersized+degraded, 96 active+clean; 585 KiB data, 202 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 79/726 objects degraded (10.882%) 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:23.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:23.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:23.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:23.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:23.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.401 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.404 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.405 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.406 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:24.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:24.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: pgmap v202: 161 pgs: 6 peering, 15 active+undersized, 10 active+undersized+degraded, 130 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 41/726 objects degraded (5.647%) 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 79/726 objects degraded (10.882%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: pgmap v202: 161 pgs: 6 peering, 15 active+undersized, 10 active+undersized+degraded, 130 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 41/726 objects degraded (5.647%) 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: pgmap v202: 161 pgs: 6 peering, 15 active+undersized, 10 active+undersized+degraded, 130 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 41/726 objects degraded (5.647%) 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 79/726 objects degraded (10.882%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 79/726 objects degraded (10.882%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:25.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:25.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:25.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:25.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:11:25.892+0000 7f82703f1640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-09-17T01:11:26.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:26.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.616 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.618 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.619 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.620 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.621 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.622 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:26.623 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:26.624 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:27.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:11:26] "GET /metrics HTTP/1.1" 200 38478 "" "Prometheus/2.43.0" 2024-09-17T01:11:27.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:27.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:27.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[105664]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-09-17T01:11:27.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[105664]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:27.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:27.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[96259]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-09-17T01:11:27.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:27 smithi071 ceph-mon[96259]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:27 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:27 smithi135 ceph-mon[89112]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-09-17T01:11:27.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:27 smithi135 ceph-mon[89112]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:28.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/726 objects degraded (5.647%), 10 pgs degraded) 2024-09-17T01:11:28.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:11:28.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/726 objects degraded (5.647%), 10 pgs degraded) 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/726 objects degraded (5.647%), 10 pgs degraded) 2024-09-17T01:11:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:11:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:28.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:29.413 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:29 smithi135 ceph-mon[89112]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:29.481 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:29 smithi071 ceph-mon[96259]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:29.482 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:29 smithi071 ceph-mon[105664]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:31.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:30 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:31.147 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:30 smithi071 ceph-mon[96259]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:30 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:31.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:30 smithi071 ceph-mon[105664]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:31.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:30 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:31.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:30 smithi135 ceph-mon[89112]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[96259]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:33.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:33 smithi071 ceph-mon[105664]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:33 smithi135 ceph-mon[89112]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:34.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:34.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:34.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:34.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:35.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:35 smithi135 ceph-mon[89112]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:35 smithi071 ceph-mon[96259]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:35.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:35 smithi071 ceph-mon[105664]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:37.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:11:36] "GET /metrics HTTP/1.1" 200 38462 "" "Prometheus/2.43.0" 2024-09-17T01:11:37.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:37 smithi071 ceph-mon[96259]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:37.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:37 smithi071 ceph-mon[105664]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:37 smithi135 ceph-mon[89112]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:11:39.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:39 smithi071 ceph-mon[96259]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:39.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:39 smithi071 ceph-mon[105664]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:39.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:39 smithi135 ceph-mon[89112]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:41 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:41 smithi071 ceph-mon[96259]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:41.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:41 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:41.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:41 smithi071 ceph-mon[105664]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:41.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:41.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:41 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:41.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:41 smithi135 ceph-mon[89112]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:41.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:42 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:42 smithi135 ceph-mon[89112]: Upgrade: osd.4 is safe to restart 2024-09-17T01:11:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:11:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[96259]: Upgrade: osd.4 is safe to restart 2024-09-17T01:11:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:11:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:11:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[105664]: Upgrade: osd.4 is safe to restart 2024-09-17T01:11:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:11:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:43 smithi071 ceph-mon[105664]: Upgrade: Updating osd.4 2024-09-17T01:11:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:43 smithi071 ceph-mon[105664]: Deploying daemon osd.4 on smithi135 2024-09-17T01:11:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:43 smithi071 ceph-mon[105664]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:43 smithi071 ceph-mon[96259]: Upgrade: Updating osd.4 2024-09-17T01:11:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:43 smithi071 ceph-mon[96259]: Deploying daemon osd.4 on smithi135 2024-09-17T01:11:43.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:43 smithi071 ceph-mon[96259]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:43 smithi135 ceph-mon[89112]: Upgrade: Updating osd.4 2024-09-17T01:11:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:43 smithi135 ceph-mon[89112]: Deploying daemon osd.4 on smithi135 2024-09-17T01:11:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:43 smithi135 ceph-mon[89112]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:45.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:45 smithi135 systemd[1]: Stopping Ceph osd.4 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:11:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:45 smithi071 ceph-mon[96259]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:45.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:45 smithi071 ceph-mon[105664]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:45 smithi135 ceph-mon[89112]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:11:45.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[29403]: 2024-09-17T01:11:45.598+0000 7f3a02129700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:11:45.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[29403]: 2024-09-17T01:11:45.598+0000 7f3a02129700 -1 osd.4 156 *** Got signal Terminated *** 2024-09-17T01:11:45.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:45 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[29403]: 2024-09-17T01:11:45.598+0000 7f3a02129700 -1 osd.4 156 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:11:46.773 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:46 smithi135 ceph-mon[89112]: osd.4 marked itself down and dead 2024-09-17T01:11:46.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:46 smithi071 ceph-mon[96259]: osd.4 marked itself down and dead 2024-09-17T01:11:46.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:46 smithi071 ceph-mon[105664]: osd.4 marked itself down and dead 2024-09-17T01:11:47.093 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:11:46] "GET /metrics HTTP/1.1" 200 38462 "" "Prometheus/2.43.0" 2024-09-17T01:11:47.298 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:11:47.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:47 smithi135 podman[112866]: 2024-09-17 01:11:47.095566352 +0000 UTC m=+1.624335629 container stop acc9e440f05cd72ef5bb0fa5108bc6bc29fef7f12938fd70d658b2683c9653e9 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, build-date=2022-05-03T08:36:31.336870, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, RELEASE=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-17T01:11:47.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:47 smithi135 podman[112866]: 2024-09-17 01:11:47.123155337 +0000 UTC m=+1.651924613 container died acc9e440f05cd72ef5bb0fa5108bc6bc29fef7f12938fd70d658b2683c9653e9 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, io.openshift.expose-services=, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, vcs-type=git, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD) 2024-09-17T01:11:47.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:47 smithi135 ceph-mon[89112]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:47.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:47 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:47.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:47 smithi135 ceph-mon[89112]: osdmap e157: 8 total, 7 up, 8 in 2024-09-17T01:11:47.849 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:47 smithi135 podman[112866]: 2024-09-17 01:11:47.682948456 +0000 UTC m=+2.211717764 container cleanup acc9e440f05cd72ef5bb0fa5108bc6bc29fef7f12938fd70d658b2683c9653e9 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=-17.2.0, version=8, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, maintainer=Guillaume Abrioux , name=centos-stream, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, io.openshift.expose-services=, release=754, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD) 2024-09-17T01:11:47.849 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:47 smithi135 bash[112866]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:11:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:47 smithi071 ceph-mon[105664]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:47 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:47 smithi071 ceph-mon[105664]: osdmap e157: 8 total, 7 up, 8 in 2024-09-17T01:11:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:47 smithi071 ceph-mon[96259]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:11:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:47 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:11:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:47 smithi071 ceph-mon[96259]: osdmap e157: 8 total, 7 up, 8 in 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 20s ago 19m - - 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 15s ago 18m - - 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (8m) 20s ago 14m 25.4M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (8m) 15s ago 13m 54.2M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (6m) 20s ago 12m 59.5M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (7m) 15s ago 18m 522M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (5m) 20s ago 19m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (5m) 20s ago 20m 63.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:11:47.975 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (4m) 15s ago 18m 48.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (4m) 20s ago 18m 54.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (8m) 20s ago 14m 15.3M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (8m) 15s ago 14m 16.5M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (2m) 20s ago 18m 53.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (2m) 20s ago 17m 57.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (85s) 20s ago 17m 45.0M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (34s) 20s ago 16m 45.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (16m) 15s ago 16m 65.1M 4096M 17.2.0 e1d6a67b021e acc9e440f05c 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (16m) 15s ago 16m 61.5M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (15m) 15s ago 15m 59.1M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (15m) 15s ago 15m 66.2M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (7m) 15s ago 14m 66.5M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:11:47.976 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (12m) 20s ago 12m 77.1M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:11:47.977 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (12m) 15s ago 12m 75.5M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:11:47.977 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (12m) 20s ago 12m 75.7M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:11:47.977 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (12m) 15s ago 12m 76.0M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:11:48.210 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:47 smithi135 podman[112893]: 2024-09-17 01:11:47.850884602 +0000 UTC m=+0.748744853 container remove acc9e440f05cd72ef5bb0fa5108bc6bc29fef7f12938fd70d658b2683c9653e9 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, ceph=True, version=8, io.openshift.expose-services=, distribution-scope=public, vendor=Red Hat, Inc., vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, release=754, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0) 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-09-17T01:11:48.393 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:11:48.394 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:11:48.568 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:48 smithi135 podman[112981]: 2024-09-17 01:11:48.201831103 +0000 UTC m=+0.020463079 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:11:48.569 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:48 smithi135 podman[112981]: 2024-09-17 01:11:48.335189594 +0000 UTC m=+0.153821558 container create 1dae8c875f747fc3e366f4ca9a8ff30f4e5844bb063d79c08d0bfca82f49bcd8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:11:48.744 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "9/23 daemons upgraded", 2024-09-17T01:11:48.745 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:11:48.745 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:11:48.745 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:11:48.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:48.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: osdmap e158: 8 total, 7 up, 8 in 2024-09-17T01:11:48.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3585437150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:48.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:48.855 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:48 smithi135 podman[112981]: 2024-09-17 01:11:48.773903302 +0000 UTC m=+0.592535263 container init 1dae8c875f747fc3e366f4ca9a8ff30f4e5844bb063d79c08d0bfca82f49bcd8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:11:48.855 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:48 smithi135 podman[112981]: 2024-09-17 01:11:48.777173768 +0000 UTC m=+0.595805729 container start 1dae8c875f747fc3e366f4ca9a8ff30f4e5844bb063d79c08d0bfca82f49bcd8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:11:48.855 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:48 smithi135 podman[112981]: 2024-09-17 01:11:48.857056971 +0000 UTC m=+0.675688947 container attach 1dae8c875f747fc3e366f4ca9a8ff30f4e5844bb063d79c08d0bfca82f49bcd8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: osdmap e158: 8 total, 7 up, 8 in 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3585437150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: osdmap e158: 8 total, 7 up, 8 in 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3585437150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:49.154 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down 2024-09-17T01:11:49.155 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:11:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: osd.4 (root=default,host=smithi135) is down 2024-09-17T01:11:49.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[96259]: from='client.64438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[96259]: from='client.44478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.661 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[96259]: pgmap v216: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:11:49.662 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/542705823' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:49.662 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[105664]: from='client.64438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.662 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[105664]: from='client.44478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.662 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[105664]: pgmap v216: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:11:49.662 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:49 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/542705823' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:49 smithi135 ceph-mon[89112]: from='client.64438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:49 smithi135 ceph-mon[89112]: from='client.44478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:49 smithi135 ceph-mon[89112]: pgmap v216: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:11:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:49 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/542705823' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:49.710 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:49 smithi135 podman[112981]: 2024-09-17 01:11:49.592679975 +0000 UTC m=+1.411311936 container died 1dae8c875f747fc3e366f4ca9a8ff30f4e5844bb063d79c08d0bfca82f49bcd8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T01:11:50.588 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 podman[113023]: 2024-09-17 01:11:50.282915718 +0000 UTC m=+1.313707549 container remove 1dae8c875f747fc3e366f4ca9a8ff30f4e5844bb063d79c08d0bfca82f49bcd8 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:11:50.589 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-17T01:11:50.589 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 systemd[1]: Stopped Ceph osd.4 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:11:50.589 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.4.service: Consumed 12.201s CPU time. 2024-09-17T01:11:50.589 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 systemd[1]: Starting Ceph osd.4 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:11:50.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:50 smithi135 ceph-mon[89112]: from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:50.861 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 podman[113191]: 2024-09-17 01:11:50.633394063 +0000 UTC m=+0.016717765 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:11:50.861 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 podman[113191]: 2024-09-17 01:11:50.742870608 +0000 UTC m=+0.126194298 container create eac1024b2ca2d0a0fe9a6e38d1f243ed911dce8299d8e8a44e6ed9cff52ed91c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731) 2024-09-17T01:11:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:50 smithi071 ceph-mon[96259]: from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:50.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:50 smithi071 ceph-mon[105664]: from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:51.210 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 podman[113191]: 2024-09-17 01:11:50.945265539 +0000 UTC m=+0.328589237 container init eac1024b2ca2d0a0fe9a6e38d1f243ed911dce8299d8e8a44e6ed9cff52ed91c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:11:51.210 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:50 smithi135 podman[113191]: 2024-09-17 01:11:50.948723848 +0000 UTC m=+0.332047548 container start eac1024b2ca2d0a0fe9a6e38d1f243ed911dce8299d8e8a44e6ed9cff52ed91c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97) 2024-09-17T01:11:51.210 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:51 smithi135 podman[113191]: 2024-09-17 01:11:51.04527885 +0000 UTC m=+0.428602542 container attach eac1024b2ca2d0a0fe9a6e38d1f243ed911dce8299d8e8a44e6ed9cff52ed91c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T01:11:51.210 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:51.210 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:51 smithi135 bash[113191]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:51.211 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:51.211 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:51 smithi135 bash[113191]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:11:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:51 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:51 smithi071 ceph-mon[105664]: pgmap v217: 161 pgs: 33 active+undersized, 3 stale+active+clean, 23 active+undersized+degraded, 102 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 107/726 objects degraded (14.738%) 2024-09-17T01:11:51.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:51 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 107/726 objects degraded (14.738%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:51.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:51 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:51.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:51 smithi071 ceph-mon[96259]: pgmap v217: 161 pgs: 33 active+undersized, 3 stale+active+clean, 23 active+undersized+degraded, 102 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 107/726 objects degraded (14.738%) 2024-09-17T01:11:51.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:51 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 107/726 objects degraded (14.738%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:51.905 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:51 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:11:51.905 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:51 smithi135 ceph-mon[89112]: pgmap v217: 161 pgs: 33 active+undersized, 3 stale+active+clean, 23 active+undersized+degraded, 102 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 107/726 objects degraded (14.738%) 2024-09-17T01:11:51.905 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:51 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 107/726 objects degraded (14.738%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:11:52.673 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:11:52.674 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 bash[113191]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:11:52.674 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:11:52.674 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 bash[113191]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:11:52.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 bash[113191]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 bash[113191]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 bash[113191]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 bash[113191]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate[113242]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:11:52.961 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:52 smithi135 bash[113191]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:11:53.496 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.496 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.497 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.497 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:53 smithi135 ceph-mon[89112]: pgmap v218: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:53.497 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:53 smithi135 podman[113191]: 2024-09-17 01:11:53.238640353 +0000 UTC m=+2.621964053 container died eac1024b2ca2d0a0fe9a6e38d1f243ed911dce8299d8e8a44e6ed9cff52ed91c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T01:11:53.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[105664]: pgmap v218: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:53.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:53.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:53 smithi071 ceph-mon[96259]: pgmap v218: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:54.136 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:53 smithi135 podman[113630]: 2024-09-17 01:11:53.773818799 +0000 UTC m=+0.908958034 container remove eac1024b2ca2d0a0fe9a6e38d1f243ed911dce8299d8e8a44e6ed9cff52ed91c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:11:54.136 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:53 smithi135 podman[113743]: 2024-09-17 01:11:53.882683336 +0000 UTC m=+0.016613177 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:11:54.136 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:53 smithi135 podman[113743]: 2024-09-17 01:11:53.991429566 +0000 UTC m=+0.125359399 container create 89346edb14b45a90a80adc03e90c569fc12beb09dc3030c9e8d7da2247827f7a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-17T01:11:54.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:54 smithi135 podman[113743]: 2024-09-17 01:11:54.243799972 +0000 UTC m=+0.377729810 container init 89346edb14b45a90a80adc03e90c569fc12beb09dc3030c9e8d7da2247827f7a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731) 2024-09-17T01:11:54.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:54 smithi135 podman[113743]: 2024-09-17 01:11:54.247226785 +0000 UTC m=+0.381156618 container start 89346edb14b45a90a80adc03e90c569fc12beb09dc3030c9e8d7da2247827f7a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T01:11:54.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:54 smithi135 ceph-osd[113791]: -- 172.21.15.135:0/3526289594 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cfb61b9a40 con 0x55cfb6f80400 2024-09-17T01:11:54.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:54 smithi135 bash[113743]: 89346edb14b45a90a80adc03e90c569fc12beb09dc3030c9e8d7da2247827f7a 2024-09-17T01:11:54.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:54 smithi135 systemd[1]: Started Ceph osd.4 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:11:55.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: pgmap v219: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:55.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: pgmap v219: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: pgmap v219: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:55.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:55.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:55.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:55.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:55.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:55.656 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.164 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:11:55.902+0000 7fed3bf04640 -1 Falling back to public interface 2024-09-17T01:11:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:56.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:56.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:56.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:56.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:56.886 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:11:56] "GET /metrics HTTP/1.1" 200 38466 "" "Prometheus/2.43.0" 2024-09-17T01:11:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: pgmap v220: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: pgmap v220: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: pgmap v220: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:57.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:57.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:57.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:57.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:58 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:58.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:58 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.463 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:11:59.442+0000 7f82703f1640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:11:59.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: pgmap v221: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.466 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.467 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.468 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.669 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: pgmap v221: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.670 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.671 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: pgmap v221: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:11:59.672 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.673 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.674 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.675 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.676 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.677 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:11:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:11:59.775 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:11:59.496+0000 7fed3bf04640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-17T01:11:59.775 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:11:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:11:59.543+0000 7fed3bf04640 -1 osd.4 156 log_to_monitors true 2024-09-17T01:12:00.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: pgmap v222: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:00.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:12:00.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:12:00.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:12:00.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:12:00.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 128/726 objects degraded (17.631%), 28 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: pgmap v222: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:12:00.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 128/726 objects degraded (17.631%), 28 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: pgmap v222: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 128/726 objects degraded (17.631%) 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:12:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:12:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:12:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:12:00.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:00 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 128/726 objects degraded (17.631%), 28 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:00.973 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:12:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:12:00.973+0000 7fed2fca7640 -1 osd.4 156 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:12:01.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:01 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:01.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:01 smithi135 ceph-mon[89112]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:12:01.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:01 smithi135 ceph-mon[89112]: osdmap e159: 8 total, 7 up, 8 in 2024-09-17T01:12:01.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:01 smithi135 ceph-mon[89112]: from='osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:01.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:01 smithi135 ceph-mon[89112]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:01.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:01 smithi135 ceph-mon[89112]: from='osd.4 ' entity='osd.4' 2024-09-17T01:12:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[105664]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:12:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[105664]: osdmap e159: 8 total, 7 up, 8 in 2024-09-17T01:12:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[105664]: from='osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[105664]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[105664]: from='osd.4 ' entity='osd.4' 2024-09-17T01:12:01.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:01.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[96259]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:12:01.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[96259]: osdmap e159: 8 total, 7 up, 8 in 2024-09-17T01:12:01.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[96259]: from='osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:01.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[96259]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:01.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:01 smithi071 ceph-mon[96259]: from='osd.4 ' entity='osd.4' 2024-09-17T01:12:02.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:02 smithi135 ceph-mon[89112]: pgmap v224: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 128/726 objects degraded (17.631%) 2024-09-17T01:12:02.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:02 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:02.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:02 smithi135 ceph-mon[89112]: osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768] boot 2024-09-17T01:12:02.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:02 smithi135 ceph-mon[89112]: osdmap e160: 8 total, 8 up, 8 in 2024-09-17T01:12:02.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:12:02.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[105664]: pgmap v224: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 128/726 objects degraded (17.631%) 2024-09-17T01:12:02.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:02.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[105664]: osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768] boot 2024-09-17T01:12:02.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[105664]: osdmap e160: 8 total, 8 up, 8 in 2024-09-17T01:12:02.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:12:02.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[96259]: pgmap v224: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 128/726 objects degraded (17.631%) 2024-09-17T01:12:02.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:02.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[96259]: osd.4 [v2:172.21.15.135:6800/2730116768,v1:172.21.15.135:6801/2730116768] boot 2024-09-17T01:12:02.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[96259]: osdmap e160: 8 total, 8 up, 8 in 2024-09-17T01:12:02.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:12:04.208 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:03 smithi135 ceph-mon[89112]: osdmap e161: 8 total, 8 up, 8 in 2024-09-17T01:12:04.208 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:03 smithi135 ceph-mon[89112]: pgmap v227: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 128/726 objects degraded (17.631%) 2024-09-17T01:12:04.208 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:04.209 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:04.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[105664]: osdmap e161: 8 total, 8 up, 8 in 2024-09-17T01:12:04.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[105664]: pgmap v227: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 128/726 objects degraded (17.631%) 2024-09-17T01:12:04.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:04.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:04.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[96259]: osdmap e161: 8 total, 8 up, 8 in 2024-09-17T01:12:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[96259]: pgmap v227: 161 pgs: 38 active+undersized, 28 active+undersized+degraded, 95 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 128/726 objects degraded (17.631%) 2024-09-17T01:12:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:04.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:05.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:05 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 50/726 objects degraded (6.887%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:05 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 50/726 objects degraded (6.887%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:05.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:05 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 50/726 objects degraded (6.887%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:06.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:06 smithi135 ceph-mon[89112]: pgmap v228: 161 pgs: 17 active+undersized, 13 active+undersized+degraded, 131 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 50/726 objects degraded (6.887%) 2024-09-17T01:12:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:06 smithi071 ceph-mon[96259]: pgmap v228: 161 pgs: 17 active+undersized, 13 active+undersized+degraded, 131 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 50/726 objects degraded (6.887%) 2024-09-17T01:12:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:06 smithi071 ceph-mon[105664]: pgmap v228: 161 pgs: 17 active+undersized, 13 active+undersized+degraded, 131 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 50/726 objects degraded (6.887%) 2024-09-17T01:12:07.140 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:12:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:12:06] "GET /metrics HTTP/1.1" 200 38331 "" "Prometheus/2.43.0" 2024-09-17T01:12:08.065 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.065 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.065 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[105664]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-09-17T01:12:08.065 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[96259]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.066 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.067 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:07 smithi135 ceph-mon[89112]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-09-17T01:12:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:08.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[96259]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:12:09.159 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/726 objects degraded (6.887%), 13 pgs degraded) 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[105664]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/726 objects degraded (6.887%), 13 pgs degraded) 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:08 smithi135 ceph-mon[89112]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:12:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:08 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/726 objects degraded (6.887%), 13 pgs degraded) 2024-09-17T01:12:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:08 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:12:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:10.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:09 smithi135 ceph-mon[89112]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 675 B/s rd, 0 op/s 2024-09-17T01:12:10.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:09 smithi071 ceph-mon[96259]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 675 B/s rd, 0 op/s 2024-09-17T01:12:10.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:09 smithi071 ceph-mon[105664]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 675 B/s rd, 0 op/s 2024-09-17T01:12:11.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:10 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:11.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:10 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:11.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:10 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:11 smithi135 ceph-mon[89112]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:12:12.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:11 smithi071 ceph-mon[96259]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:12:12.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:11 smithi071 ceph-mon[105664]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:12:14.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:14 smithi135 ceph-mon[89112]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:12:14.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:14.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:14.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:14 smithi071 ceph-mon[96259]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:12:14.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:14.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:14 smithi071 ceph-mon[105664]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-17T01:12:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:15 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:15 smithi071 ceph-mon[105664]: Upgrade: osd.5 is safe to restart 2024-09-17T01:12:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:15 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:15 smithi071 ceph-mon[96259]: Upgrade: osd.5 is safe to restart 2024-09-17T01:12:15.905 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:15 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:12:15.905 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:15 smithi135 ceph-mon[89112]: Upgrade: osd.5 is safe to restart 2024-09-17T01:12:16.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[96259]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-09-17T01:12:16.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:16.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:12:16.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[105664]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-09-17T01:12:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:12:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:16.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:12:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:12:16] "GET /metrics HTTP/1.1" 200 38331 "" "Prometheus/2.43.0" 2024-09-17T01:12:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:16 smithi135 ceph-mon[89112]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-09-17T01:12:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:12:16.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:17.744 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:17 smithi135 ceph-mon[89112]: Upgrade: Updating osd.5 2024-09-17T01:12:17.744 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:17 smithi135 ceph-mon[89112]: Deploying daemon osd.5 on smithi135 2024-09-17T01:12:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:17 smithi071 ceph-mon[96259]: Upgrade: Updating osd.5 2024-09-17T01:12:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:17 smithi071 ceph-mon[96259]: Deploying daemon osd.5 on smithi135 2024-09-17T01:12:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:17 smithi071 ceph-mon[105664]: Upgrade: Updating osd.5 2024-09-17T01:12:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:17 smithi071 ceph-mon[105664]: Deploying daemon osd.5 on smithi135 2024-09-17T01:12:18.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:18 smithi135 ceph-mon[89112]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-09-17T01:12:18.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:18.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:18.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:18 smithi071 ceph-mon[96259]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-09-17T01:12:18.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:18.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:18.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:18 smithi071 ceph-mon[105664]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 884 B/s rd, 0 op/s 2024-09-17T01:12:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:19.009 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:18 smithi135 systemd[1]: Stopping Ceph osd.5 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:12:19.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[32280]: 2024-09-17T01:12:19.011+0000 7f169d91b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:12:19.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[32280]: 2024-09-17T01:12:19.011+0000 7f169d91b700 -1 osd.5 161 *** Got signal Terminated *** 2024-09-17T01:12:19.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[32280]: 2024-09-17T01:12:19.011+0000 7f169d91b700 -1 osd.5 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:12:19.535 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:12:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:19 smithi071 ceph-mon[96259]: osd.5 marked itself down and dead 2024-09-17T01:12:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:19 smithi071 ceph-mon[105664]: osd.5 marked itself down and dead 2024-09-17T01:12:19.906 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:19 smithi135 ceph-mon[89112]: osd.5 marked itself down and dead 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 11s ago 19m - - 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 13s ago 19m - - 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (9m) 11s ago 14m 25.5M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (8m) 13s ago 14m 53.1M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (7m) 11s ago 12m 61.6M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (7m) 13s ago 18m 523M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (6m) 11s ago 20m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (5m) 11s ago 20m 65.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (4m) 13s ago 19m 47.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:12:20.198 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (5m) 11s ago 19m 54.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (9m) 11s ago 15m 15.0M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (8m) 13s ago 14m 16.2M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (3m) 11s ago 18m 53.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (2m) 11s ago 18m 57.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (117s) 11s ago 17m 45.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (66s) 11s ago 17m 47.3M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (26s) 13s ago 16m 54.1M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (16m) 13s ago 16m 62.5M 4096M 17.2.0 e1d6a67b021e e38437d9a38b 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (16m) 13s ago 16m 60.6M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (15m) 13s ago 15m 66.6M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (7m) 13s ago 15m 63.4M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (13m) 11s ago 13m 77.2M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (13m) 13s ago 13m 75.6M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:12:20.199 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (12m) 11s ago 12m 75.9M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:12:20.200 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (12m) 13s ago 12m 76.2M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:12:20.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:20 smithi135 ceph-mon[89112]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:12:20.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:20 smithi135 ceph-mon[89112]: from='client.44508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:20.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:20 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:20.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:20 smithi135 ceph-mon[89112]: osdmap e162: 8 total, 7 up, 8 in 2024-09-17T01:12:20.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:20 smithi135 podman[117248]: 2024-09-17 01:12:20.351074127 +0000 UTC m=+1.458781226 container died e38437d9a38b3829dba85ecf4e9b0a744722503eb2c8a19f1af787a08b6abcb7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, io.buildah.version=1.19.8, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, ceph=True, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, com.redhat.component=centos-stream-container, RELEASE=HEAD) 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:12:20.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 10 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:12:20.622 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:12:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[96259]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:12:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[96259]: from='client.44508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[96259]: osdmap e162: 8 total, 7 up, 8 in 2024-09-17T01:12:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[105664]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:12:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[105664]: from='client.44508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:20 smithi071 ceph-mon[105664]: osdmap e162: 8 total, 7 up, 8 in 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:12:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:12:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "10/23 daemons upgraded", 2024-09-17T01:12:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:12:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:12:20.956 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:12:20.960 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:20 smithi135 podman[117248]: 2024-09-17 01:12:20.716043941 +0000 UTC m=+1.823751099 container cleanup e38437d9a38b3829dba85ecf4e9b0a744722503eb2c8a19f1af787a08b6abcb7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, io.openshift.expose-services=, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, ceph=True, name=centos-stream, release=754, io.buildah.version=1.19.8, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-17T01:12:20.960 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:20 smithi135 bash[117248]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:12:21.346 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down 2024-09-17T01:12:21.346 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:12:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: osd.5 (root=default,host=smithi135) is down 2024-09-17T01:12:21.434 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:20 smithi135 podman[117285]: 2024-09-17 01:12:20.980123139 +0000 UTC m=+0.960965670 container remove e38437d9a38b3829dba85ecf4e9b0a744722503eb2c8a19f1af787a08b6abcb7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, GIT_CLEAN=True, io.openshift.expose-services=, com.redhat.component=centos-stream-container, version=8) 2024-09-17T01:12:21.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:21.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[96259]: from='client.44514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[96259]: from='client.44520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[96259]: osdmap e163: 8 total, 7 up, 8 in 2024-09-17T01:12:21.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/911287082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:21.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1045691748' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[105664]: from='client.44514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[105664]: from='client.44520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[105664]: osdmap e163: 8 total, 7 up, 8 in 2024-09-17T01:12:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/911287082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:21.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:21 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1045691748' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:21 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:21 smithi135 ceph-mon[89112]: from='client.44514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:21 smithi135 ceph-mon[89112]: from='client.44520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:21 smithi135 ceph-mon[89112]: osdmap e163: 8 total, 7 up, 8 in 2024-09-17T01:12:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:21 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/911287082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:21.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:21 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1045691748' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:21.711 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:21 smithi135 podman[117393]: 2024-09-17 01:12:21.561872819 +0000 UTC m=+0.015780306 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:12:21.711 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:21 smithi135 podman[117393]: 2024-09-17 01:12:21.671180926 +0000 UTC m=+0.125088397 container create b1012b6d241c0448aa5627bf8dcccf0d7a2fe93f9e2d29d19fee281acdf8bac5 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-17T01:12:22.094 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:21 smithi135 podman[117393]: 2024-09-17 01:12:21.93233881 +0000 UTC m=+0.386246281 container init b1012b6d241c0448aa5627bf8dcccf0d7a2fe93f9e2d29d19fee281acdf8bac5 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-17T01:12:22.094 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:21 smithi135 podman[117393]: 2024-09-17 01:12:21.935637893 +0000 UTC m=+0.389545373 container start b1012b6d241c0448aa5627bf8dcccf0d7a2fe93f9e2d29d19fee281acdf8bac5 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-17T01:12:22.094 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:22 smithi135 podman[117393]: 2024-09-17 01:12:22.015948396 +0000 UTC m=+0.469855885 container attach b1012b6d241c0448aa5627bf8dcccf0d7a2fe93f9e2d29d19fee281acdf8bac5 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97) 2024-09-17T01:12:22.400 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:22 smithi135 podman[117393]: 2024-09-17 01:12:22.129958003 +0000 UTC m=+0.583865474 container died b1012b6d241c0448aa5627bf8dcccf0d7a2fe93f9e2d29d19fee281acdf8bac5 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:12:22.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:22 smithi135 ceph-mon[89112]: pgmap v238: 161 pgs: 17 peering, 11 stale+active+clean, 133 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:12:22.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:22 smithi135 ceph-mon[89112]: from='client.44532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:22.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:22 smithi135 ceph-mon[89112]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-17T01:12:22.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:22 smithi071 ceph-mon[96259]: pgmap v238: 161 pgs: 17 peering, 11 stale+active+clean, 133 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:12:22.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:22 smithi071 ceph-mon[96259]: from='client.44532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:22.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:22 smithi071 ceph-mon[96259]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-17T01:12:22.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:22 smithi071 ceph-mon[105664]: pgmap v238: 161 pgs: 17 peering, 11 stale+active+clean, 133 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:12:22.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:22 smithi071 ceph-mon[105664]: from='client.44532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:22 smithi071 ceph-mon[105664]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-17T01:12:23.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:22 smithi135 podman[117456]: 2024-09-17 01:12:22.878570554 +0000 UTC m=+0.738842816 container remove b1012b6d241c0448aa5627bf8dcccf0d7a2fe93f9e2d29d19fee281acdf8bac5 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-17T01:12:23.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:22 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T01:12:23.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:22 smithi135 systemd[1]: Stopped Ceph osd.5 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:12:23.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:22 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.5.service: Consumed 13.464s CPU time. 2024-09-17T01:12:23.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 systemd[1]: Starting Ceph osd.5 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:12:23.613 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 podman[117634]: 2024-09-17 01:12:23.23253165 +0000 UTC m=+0.016410589 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:12:23.613 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 podman[117634]: 2024-09-17 01:12:23.35460397 +0000 UTC m=+0.138482882 container create 28ff8335b385d3940e7429433e841f2f767b797f1c2ec78592c96b337ea9e598 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:12:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:23 smithi071 ceph-mon[105664]: pgmap v239: 161 pgs: 11 active+undersized, 17 peering, 6 stale+active+clean, 2 active+undersized+degraded, 125 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 12/726 objects degraded (1.653%) 2024-09-17T01:12:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:23 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 12/726 objects degraded (1.653%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:23 smithi071 ceph-mon[96259]: pgmap v239: 161 pgs: 11 active+undersized, 17 peering, 6 stale+active+clean, 2 active+undersized+degraded, 125 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 12/726 objects degraded (1.653%) 2024-09-17T01:12:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:23 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 12/726 objects degraded (1.653%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:23 smithi135 ceph-mon[89112]: pgmap v239: 161 pgs: 11 active+undersized, 17 peering, 6 stale+active+clean, 2 active+undersized+degraded, 125 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 12/726 objects degraded (1.653%) 2024-09-17T01:12:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:23 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 12/726 objects degraded (1.653%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:23.960 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 podman[117634]: 2024-09-17 01:12:23.615890123 +0000 UTC m=+0.399769036 container init 28ff8335b385d3940e7429433e841f2f767b797f1c2ec78592c96b337ea9e598 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-c2ddf97) 2024-09-17T01:12:23.960 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 podman[117634]: 2024-09-17 01:12:23.619798113 +0000 UTC m=+0.403677024 container start 28ff8335b385d3940e7429433e841f2f767b797f1c2ec78592c96b337ea9e598 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:12:23.961 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 podman[117634]: 2024-09-17 01:12:23.715957846 +0000 UTC m=+0.499836764 container attach 28ff8335b385d3940e7429433e841f2f767b797f1c2ec78592c96b337ea9e598 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-17T01:12:23.961 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:23.961 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 bash[117634]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:23.961 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:23.961 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:23 smithi135 bash[117634]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:25.143 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:12:25.143 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:24 smithi135 bash[117634]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:12:25.143 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:25.143 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:24 smithi135 bash[117634]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:25.143 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:25.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 bash[117634]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:12:25.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:12:25.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 bash[117634]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:12:25.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:12:25.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 bash[117634]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:12:25.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:12:25.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 bash[117634]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:12:25.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate[117661]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:12:25.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 bash[117634]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:12:25.833 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:25 smithi135 podman[117634]: 2024-09-17 01:12:25.505621782 +0000 UTC m=+2.289500693 container died 28ff8335b385d3940e7429433e841f2f767b797f1c2ec78592c96b337ea9e598 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-17T01:12:26.166 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:25 smithi135 ceph-mon[89112]: pgmap v240: 161 pgs: 27 active+undersized, 17 peering, 12 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-09-17T01:12:26.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:25 smithi071 ceph-mon[96259]: pgmap v240: 161 pgs: 27 active+undersized, 17 peering, 12 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-09-17T01:12:26.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:25 smithi071 ceph-mon[105664]: pgmap v240: 161 pgs: 27 active+undersized, 17 peering, 12 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 43/726 objects degraded (5.923%) 2024-09-17T01:12:26.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:26 smithi135 podman[117974]: 2024-09-17 01:12:26.169302346 +0000 UTC m=+0.987141236 container remove 28ff8335b385d3940e7429433e841f2f767b797f1c2ec78592c96b337ea9e598 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T01:12:27.023 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:12:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:12:26] "GET /metrics HTTP/1.1" 200 38472 "" "Prometheus/2.43.0" 2024-09-17T01:12:27.273 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:27 smithi135 ceph-mon[89112]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 6 pgs peering) 2024-09-17T01:12:27.363 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:27 smithi071 ceph-mon[96259]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 6 pgs peering) 2024-09-17T01:12:27.364 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:27 smithi071 ceph-mon[105664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 6 pgs peering) 2024-09-17T01:12:28.376 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[105664]: pgmap v241: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:28.377 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.377 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.377 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.377 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[96259]: pgmap v241: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:28.377 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.377 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.377 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:28 smithi135 ceph-mon[89112]: pgmap v241: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:28.941 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:28 smithi135 podman[118310]: 2024-09-17 01:12:28.575610915 +0000 UTC m=+0.018537865 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:12:28.941 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:28 smithi135 podman[118310]: 2024-09-17 01:12:28.699533228 +0000 UTC m=+0.142460205 container create d0a342ff987682cc57b5e6a004563f7c3621c84460fb10d1175d4c79096229df (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-17T01:12:28.941 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:28 smithi135 podman[118310]: 2024-09-17 01:12:28.943605793 +0000 UTC m=+0.386532732 container init d0a342ff987682cc57b5e6a004563f7c3621c84460fb10d1175d4c79096229df (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T01:12:29.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:28 smithi135 podman[118310]: 2024-09-17 01:12:28.947297668 +0000 UTC m=+0.390224613 container start d0a342ff987682cc57b5e6a004563f7c3621c84460fb10d1175d4c79096229df (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:12:29.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:28 smithi135 ceph-osd[118370]: -- 172.21.15.135:0/3158490216 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bcc286fa40 con 0x55bcc3636000 2024-09-17T01:12:29.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:29 smithi135 bash[118310]: d0a342ff987682cc57b5e6a004563f7c3621c84460fb10d1175d4c79096229df 2024-09-17T01:12:29.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:29 smithi135 systemd[1]: Started Ceph osd.5 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:12:29.503 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.503 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.503 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.504 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:29.505 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.505 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.505 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.505 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:29.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: pgmap v242: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: pgmap v243: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: pgmap v244: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 77/726 objects degraded (10.606%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: pgmap v242: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: pgmap v243: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: pgmap v244: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 77/726 objects degraded (10.606%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.710 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:12:30.577+0000 7f6d5b202640 -1 Falling back to public interface 2024-09-17T01:12:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: pgmap v242: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: pgmap v243: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: pgmap v244: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 77/726 objects degraded (10.606%) 2024-09-17T01:12:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 77/726 objects degraded (10.606%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:30.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:30.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:30.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:30.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:30.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.648 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:31.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:31.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:31.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:31.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:31.655 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: pgmap v245: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: pgmap v245: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.402 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.403 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: pgmap v245: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:32.465 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.560 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.561 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.562 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.563 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.564 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:33.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:33.656 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:33.657 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.170 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:12:34.140+0000 7f6d5b202640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-17T01:12:34.424 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:12:34.172+0000 7f6d5b202640 -1 osd.5 161 log_to_monitors true 2024-09-17T01:12:34.426 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.426 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.426 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.426 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.426 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: pgmap v246: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:34.426 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.429 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.431 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: pgmap v246: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: pgmap v246: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:12:34.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:34.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.755 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:12:35.609+0000 7f6d4efa5640 -1 osd.5 161 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:12:35.756 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.756 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.756 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.758 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: osdmap e164: 8 total, 7 up, 8 in 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.759 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.760 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.760 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.760 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.760 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.760 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.760 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.760 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:35 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: osdmap e164: 8 total, 7 up, 8 in 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: osdmap e164: 8 total, 7 up, 8 in 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:35.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:35.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:35 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: pgmap v247: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='osd.5 ' entity='osd.5' 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.650 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.651 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.651 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.651 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.651 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.651 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.651 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.651 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: pgmap v247: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='osd.5 ' entity='osd.5' 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: pgmap v247: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='osd.5 ' entity='osd.5' 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:36.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:36.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:36.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:36.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:12:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:12:36] "GET /metrics HTTP/1.1" 200 38479 "" "Prometheus/2.43.0" 2024-09-17T01:12:37.578 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.578 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.578 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.578 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.578 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026] boot 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: osdmap e165: 8 total, 8 up, 8 in 2024-09-17T01:12:37.579 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.580 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.581 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.582 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:37 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026] boot 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: osdmap e165: 8 total, 8 up, 8 in 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: osd.5 [v2:172.21.15.135:6808/2621766026,v1:172.21.15.135:6809/2621766026] boot 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: osdmap e165: 8 total, 8 up, 8 in 2024-09-17T01:12:37.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:37.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:37.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:37.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:37.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:37 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:38.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.065 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: pgmap v250: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.066 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: osdmap e166: 8 total, 8 up, 8 in 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.068 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.069 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.070 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: pgmap v250: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.071 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: osdmap e166: 8 total, 8 up, 8 in 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.072 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.073 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: pgmap v250: 161 pgs: 37 active+undersized, 19 active+undersized+degraded, 105 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 77/726 objects degraded (10.606%) 2024-09-17T01:12:40.076 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.077 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: osdmap e166: 8 total, 8 up, 8 in 2024-09-17T01:12:40.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.078 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.079 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.080 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.081 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.081 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.082 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.083 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.084 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.085 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.086 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:39 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.087 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.088 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.089 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.091 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.092 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.093 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.094 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.095 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.096 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.097 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.098 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.099 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.100 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:39 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: pgmap v252: 161 pgs: 36 active+undersized, 16 active+undersized+degraded, 109 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 66/726 objects degraded (9.091%) 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 66/726 objects degraded (9.091%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:40.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: pgmap v252: 161 pgs: 36 active+undersized, 16 active+undersized+degraded, 109 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 66/726 objects degraded (9.091%) 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: pgmap v252: 161 pgs: 36 active+undersized, 16 active+undersized+degraded, 109 active+clean; 585 KiB data, 304 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 66/726 objects degraded (9.091%) 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:40.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 66/726 objects degraded (9.091%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 66/726 objects degraded (9.091%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:40.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:40.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:41.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:41.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.786 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: pgmap v253: 161 pgs: 7 active+undersized, 1 active+undersized+degraded, 153 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 11/726 objects degraded (1.515%) 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.788 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:42 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: pgmap v253: 161 pgs: 7 active+undersized, 1 active+undersized+degraded, 153 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 11/726 objects degraded (1.515%) 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: pgmap v253: 161 pgs: 7 active+undersized, 1 active+undersized+degraded, 153 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 11/726 objects degraded (1.515%) 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:42.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:42.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:42.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:42.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:42.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:42 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:43 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:43.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:43.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:43.909 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:43 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/726 objects degraded (1.515%), 1 pg degraded) 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/726 objects degraded (1.515%), 1 pg degraded) 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/726 objects degraded (1.515%), 1 pg degraded) 2024-09-17T01:12:44.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:44.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:12:44.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:44.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:45.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:45 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:45 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:45 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:45 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:12:45.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:45 smithi135 ceph-mon[89112]: Upgrade: osd.6 is safe to restart 2024-09-17T01:12:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:12:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[96259]: Upgrade: osd.6 is safe to restart 2024-09-17T01:12:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:12:45.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:45 smithi071 ceph-mon[105664]: Upgrade: osd.6 is safe to restart 2024-09-17T01:12:46.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:46 smithi135 ceph-mon[89112]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 0 op/s 2024-09-17T01:12:46.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:46 smithi071 ceph-mon[96259]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 0 op/s 2024-09-17T01:12:46.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:46 smithi071 ceph-mon[105664]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 601 B/s rd, 0 op/s 2024-09-17T01:12:47.023 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:12:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:12:46] "GET /metrics HTTP/1.1" 200 38479 "" "Prometheus/2.43.0" 2024-09-17T01:12:48.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[96259]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:12:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[105664]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:12:48.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:48.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:48 smithi135 ceph-mon[89112]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:12:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:12:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:12:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:49.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:12:49.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:50.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:50 smithi135 ceph-mon[89112]: Upgrade: Updating osd.6 2024-09-17T01:12:50.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:50 smithi135 ceph-mon[89112]: Deploying daemon osd.6 on smithi135 2024-09-17T01:12:50.636 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:50 smithi135 ceph-mon[89112]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 889 B/s rd, 0 op/s 2024-09-17T01:12:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:50 smithi071 ceph-mon[96259]: Upgrade: Updating osd.6 2024-09-17T01:12:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:50 smithi071 ceph-mon[96259]: Deploying daemon osd.6 on smithi135 2024-09-17T01:12:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:50 smithi071 ceph-mon[96259]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 889 B/s rd, 0 op/s 2024-09-17T01:12:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:50 smithi071 ceph-mon[105664]: Upgrade: Updating osd.6 2024-09-17T01:12:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:50 smithi071 ceph-mon[105664]: Deploying daemon osd.6 on smithi135 2024-09-17T01:12:50.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:50 smithi071 ceph-mon[105664]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 889 B/s rd, 0 op/s 2024-09-17T01:12:51.723 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:51 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:51.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:51 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:51.724 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:12:51.819 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:51 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:12:51.819 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:51 smithi135 systemd[1]: Stopping Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:12:52.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[35176]: 2024-09-17T01:12:51.820+0000 7f911cb7b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:12:52.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[35176]: 2024-09-17T01:12:51.820+0000 7f911cb7b700 -1 osd.6 166 *** Got signal Terminated *** 2024-09-17T01:12:52.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[35176]: 2024-09-17T01:12:51.820+0000 7f911cb7b700 -1 osd.6 166 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:12:52.390 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:12:52.390 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 3s ago 20m - - 2024-09-17T01:12:52.390 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 7s ago 19m - - 2024-09-17T01:12:52.390 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (9m) 3s ago 15m 25.5M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:12:52.390 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (9m) 7s ago 15m 53.1M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:12:52.390 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (7m) 3s ago 13m 61.6M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:12:52.390 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (8m) 7s ago 19m 525M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (7m) 3s ago 21m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (6m) 3s ago 21m 68.4M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (5m) 7s ago 19m 50.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (5m) 3s ago 19m 57.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (9m) 3s ago 15m 15.1M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (9m) 7s ago 15m 16.4M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (4m) 3s ago 19m 56.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (3m) 3s ago 18m 58.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (2m) 3s ago 18m 47.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (98s) 3s ago 17m 48.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (58s) 7s ago 17m 54.6M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (23s) 7s ago 17m 51.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d0a342ff9876 2024-09-17T01:12:52.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (16m) 7s ago 16m 60.9M 4096M 17.2.0 e1d6a67b021e 6dd747913960 2024-09-17T01:12:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (16m) 7s ago 16m 67.6M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:12:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (8m) 7s ago 15m 65.9M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:12:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (13m) 3s ago 13m 77.4M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:12:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (13m) 7s ago 13m 75.9M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:12:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (13m) 3s ago 13m 76.2M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:12:52.392 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (13m) 7s ago 13m 76.4M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:12:52.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:52 smithi071 ceph-mon[96259]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:52.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:52 smithi071 ceph-mon[96259]: osd.6 marked itself down and dead 2024-09-17T01:12:52.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:52 smithi071 ceph-mon[105664]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:52.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:52 smithi071 ceph-mon[105664]: osd.6 marked itself down and dead 2024-09-17T01:12:52.806 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:12:52.806 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:12:52.806 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:12:52.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:52.806 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 11 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:12:52.807 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:12:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:52 smithi135 ceph-mon[89112]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:12:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:52 smithi135 ceph-mon[89112]: osd.6 marked itself down and dead 2024-09-17T01:12:53.138 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "11/23 daemons upgraded", 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:12:53.139 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:12:53.381 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:52 smithi135 podman[124525]: 2024-09-17 01:12:52.99535667 +0000 UTC m=+1.305379015 container died 6dd74791396084f69522400891bc7afc4057d076d7636f8e885602a29229dbd7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, ceph=True, build-date=2022-05-03T08:36:31.336870, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, release=754, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public) 2024-09-17T01:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down 2024-09-17T01:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:12:53.531 INFO:teuthology.orchestra.run.smithi071.stdout: osd.6 (root=default,host=smithi135) is down 2024-09-17T01:12:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: from='client.44556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: osdmap e167: 8 total, 7 up, 8 in 2024-09-17T01:12:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2421559114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3991623255' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:53 smithi135 ceph-mon[89112]: osdmap e168: 8 total, 7 up, 8 in 2024-09-17T01:12:53.711 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:53 smithi135 podman[124525]: 2024-09-17 01:12:53.487761097 +0000 UTC m=+1.797783441 container cleanup 6dd74791396084f69522400891bc7afc4057d076d7636f8e885602a29229dbd7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, RELEASE=HEAD, vendor=Red Hat, Inc., io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, release=754, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, GIT_CLEAN=True, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-09-17T01:12:53.711 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:53 smithi135 bash[124525]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6 2024-09-17T01:12:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: from='client.44556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: osdmap e167: 8 total, 7 up, 8 in 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2421559114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3991623255' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[96259]: osdmap e168: 8 total, 7 up, 8 in 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: from='client.44556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:12:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: osdmap e167: 8 total, 7 up, 8 in 2024-09-17T01:12:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2421559114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3991623255' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:12:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:53 smithi071 ceph-mon[105664]: osdmap e168: 8 total, 7 up, 8 in 2024-09-17T01:12:54.065 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:53 smithi135 podman[124542]: 2024-09-17 01:12:53.739370241 +0000 UTC m=+0.740036694 container remove 6dd74791396084f69522400891bc7afc4057d076d7636f8e885602a29229dbd7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, io.openshift.expose-services=, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, distribution-scope=public, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, RELEASE=HEAD) 2024-09-17T01:12:54.382 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:54 smithi135 podman[124628]: 2024-09-17 01:12:53.971291727 +0000 UTC m=+0.016068966 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:12:54.382 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:54 smithi135 podman[124628]: 2024-09-17 01:12:54.08206818 +0000 UTC m=+0.126845409 container create 2dfd88e0be0d91aa257d18047d0871d288159a188c5467e0d427029ae91814e1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:12:54.383 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:54 smithi135 podman[124628]: 2024-09-17 01:12:54.301695992 +0000 UTC m=+0.346473230 container init 2dfd88e0be0d91aa257d18047d0871d288159a188c5467e0d427029ae91814e1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T01:12:54.383 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:54 smithi135 podman[124628]: 2024-09-17 01:12:54.305132777 +0000 UTC m=+0.349910006 container start 2dfd88e0be0d91aa257d18047d0871d288159a188c5467e0d427029ae91814e1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:12:54.383 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:54 smithi135 podman[124628]: 2024-09-17 01:12:54.385077456 +0000 UTC m=+0.429854688 container attach 2dfd88e0be0d91aa257d18047d0871d288159a188c5467e0d427029ae91814e1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:12:54.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:54 smithi135 ceph-mon[89112]: pgmap v260: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:12:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:54 smithi135 ceph-mon[89112]: from='client.64540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:54.711 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:54 smithi135 podman[124628]: 2024-09-17 01:12:54.489231194 +0000 UTC m=+0.534008422 container died 2dfd88e0be0d91aa257d18047d0871d288159a188c5467e0d427029ae91814e1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T01:12:54.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:54 smithi071 ceph-mon[96259]: pgmap v260: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:12:54.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:54 smithi071 ceph-mon[96259]: from='client.64540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:54.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:54 smithi071 ceph-mon[105664]: pgmap v260: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:12:54.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:54 smithi071 ceph-mon[105664]: from='client.64540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:55.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 podman[124651]: 2024-09-17 01:12:55.080687733 +0000 UTC m=+0.585504797 container remove 2dfd88e0be0d91aa257d18047d0871d288159a188c5467e0d427029ae91814e1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:12:55.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.6.service: Deactivated successfully. 2024-09-17T01:12:55.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 systemd[1]: Stopped Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:12:55.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.6.service: Consumed 10.258s CPU time. 2024-09-17T01:12:55.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 systemd[1]: Starting Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:12:55.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:55 smithi135 ceph-mon[89112]: pgmap v262: 161 pgs: 10 active+undersized, 10 stale+active+clean, 4 active+undersized+degraded, 137 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 18/726 objects degraded (2.479%) 2024-09-17T01:12:55.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:55 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 18/726 objects degraded (2.479%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:55.849 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 podman[124751]: 2024-09-17 01:12:55.416617227 +0000 UTC m=+0.016771888 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:12:55.849 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 podman[124751]: 2024-09-17 01:12:55.531875701 +0000 UTC m=+0.132030369 container create 4a2e394647f9fe1717761c9640f43c2cd04a00eeda70b6b727e4aa81dca12a1e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T01:12:55.849 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 podman[124751]: 2024-09-17 01:12:55.759712805 +0000 UTC m=+0.359867470 container init 4a2e394647f9fe1717761c9640f43c2cd04a00eeda70b6b727e4aa81dca12a1e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-17T01:12:55.849 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 podman[124751]: 2024-09-17 01:12:55.763383182 +0000 UTC m=+0.363537850 container start 4a2e394647f9fe1717761c9640f43c2cd04a00eeda70b6b727e4aa81dca12a1e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:12:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:55 smithi071 ceph-mon[96259]: pgmap v262: 161 pgs: 10 active+undersized, 10 stale+active+clean, 4 active+undersized+degraded, 137 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 18/726 objects degraded (2.479%) 2024-09-17T01:12:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:55 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 18/726 objects degraded (2.479%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:55.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:55 smithi071 ceph-mon[105664]: pgmap v262: 161 pgs: 10 active+undersized, 10 stale+active+clean, 4 active+undersized+degraded, 137 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 18/726 objects degraded (2.479%) 2024-09-17T01:12:55.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:55 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 18/726 objects degraded (2.479%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:12:56.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 podman[124751]: 2024-09-17 01:12:55.851275496 +0000 UTC m=+0.451430163 container attach 4a2e394647f9fe1717761c9640f43c2cd04a00eeda70b6b727e4aa81dca12a1e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:12:56.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:56.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 bash[124751]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:56.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:56.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:55 smithi135 bash[124751]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:12:56.950 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:12:56] "GET /metrics HTTP/1.1" 200 38489 "" "Prometheus/2.43.0" 2024-09-17T01:12:56.951 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:12:56.951 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 bash[124751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:12:56.951 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:12:56.951 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 bash[124751]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 bash[124751]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 bash[124751]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 bash[124751]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:12:57.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 bash[124751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:12:57.211 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[124766]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-17T01:12:57.211 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 bash[124751]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-17T01:12:57.211 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:56 smithi135 podman[124751]: 2024-09-17 01:12:56.982124416 +0000 UTC m=+1.582279077 container died 4a2e394647f9fe1717761c9640f43c2cd04a00eeda70b6b727e4aa81dca12a1e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T01:12:57.897 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:57 smithi135 podman[124898]: 2024-09-17 01:12:57.621995712 +0000 UTC m=+0.633552364 container remove 4a2e394647f9fe1717761c9640f43c2cd04a00eeda70b6b727e4aa81dca12a1e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T01:12:57.897 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:57 smithi135 podman[124958]: 2024-09-17 01:12:57.730059026 +0000 UTC m=+0.016143522 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:12:58.169 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:57 smithi135 podman[124958]: 2024-09-17 01:12:57.89810813 +0000 UTC m=+0.184192656 container create c26c6210123c49476d40f01f57ae4d0e1ca2d0b8a4306a1273230ab1b25bb937 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:12:58.169 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:58 smithi135 podman[124958]: 2024-09-17 01:12:58.110609148 +0000 UTC m=+0.396693628 container init c26c6210123c49476d40f01f57ae4d0e1ca2d0b8a4306a1273230ab1b25bb937 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T01:12:58.169 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:58 smithi135 podman[124958]: 2024-09-17 01:12:58.11383339 +0000 UTC m=+0.399917878 container start c26c6210123c49476d40f01f57ae4d0e1ca2d0b8a4306a1273230ab1b25bb937 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-17T01:12:58.169 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:58 smithi135 ceph-osd[124977]: -- 172.21.15.135:0/626437555 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564e4f3e9a40 con 0x564e4f3c7c00 2024-09-17T01:12:58.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:58 smithi135 ceph-mon[89112]: pgmap v263: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:12:58.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:58 smithi135 bash[124958]: c26c6210123c49476d40f01f57ae4d0e1ca2d0b8a4306a1273230ab1b25bb937 2024-09-17T01:12:58.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:12:58 smithi135 systemd[1]: Started Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:12:58.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:58 smithi071 ceph-mon[96259]: pgmap v263: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:12:58.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:58 smithi071 ceph-mon[105664]: pgmap v263: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:12:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.464 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:12:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:12:59.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:59.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:59.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:59.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:59.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:12:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[124973]: 2024-09-17T01:12:59.999+0000 7f8148738640 -1 Falling back to public interface 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: pgmap v264: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.589 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:00 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: pgmap v264: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: pgmap v264: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:00.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:00.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:00.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:00 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.600 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:01 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:01.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:01.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:01 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: pgmap v265: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.398 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.399 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: pgmap v265: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.401 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.402 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.403 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.404 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.405 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:02 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.583 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: pgmap v265: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.584 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.585 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.586 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.587 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:02.588 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:02 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.518 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[124973]: 2024-09-17T01:13:03.267+0000 7f8148738640 -1 osd.6 0 read_superblock omap replica is missing. 2024-09-17T01:13:03.518 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[124973]: 2024-09-17T01:13:03.308+0000 7f8148738640 -1 osd.6 166 log_to_monitors true 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.521 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.522 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:03.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:03.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.471 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[124973]: 2024-09-17T01:13:04.311+0000 7f81404e3640 -1 osd.6 166 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: pgmap v266: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:04.472 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.473 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.474 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.474 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.474 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.474 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.474 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.474 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.474 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.475 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.476 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: pgmap v266: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: pgmap v266: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:04.649 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.651 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.652 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:04.655 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: osdmap e169: 8 total, 7 up, 8 in 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:13:05.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:05 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:05.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T01:13:05.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: osdmap e169: 8 total, 7 up, 8 in 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: osdmap e169: 8 total, 7 up, 8 in 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:05.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:05.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:05.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:05.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:13:05.653 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:13:05.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:05 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:06.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:13:06.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-mon[89112]: Upgrade: osd.6 is safe to restart 2024-09-17T01:13:06.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-mon[89112]: pgmap v268: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:06.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:06.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-mon[89112]: osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820] boot 2024-09-17T01:13:06.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-mon[89112]: osdmap e170: 8 total, 8 up, 8 in 2024-09-17T01:13:06.345 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:13:06.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:13:06.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[96259]: Upgrade: osd.6 is safe to restart 2024-09-17T01:13:06.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[96259]: pgmap v268: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:06.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:06.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[96259]: osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820] boot 2024-09-17T01:13:06.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[96259]: osdmap e170: 8 total, 8 up, 8 in 2024-09-17T01:13:06.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:13:06.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-17T01:13:06.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[105664]: Upgrade: osd.6 is safe to restart 2024-09-17T01:13:06.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[105664]: pgmap v268: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 87/726 objects degraded (11.983%) 2024-09-17T01:13:06.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:06.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[105664]: osd.6 [v2:172.21.15.135:6816/2297019820,v1:172.21.15.135:6817/2297019820] boot 2024-09-17T01:13:06.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[105664]: osdmap e170: 8 total, 8 up, 8 in 2024-09-17T01:13:06.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:13:06.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:13:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:13:06] "GET /metrics HTTP/1.1" 200 38488 "" "Prometheus/2.43.0" 2024-09-17T01:13:07.444 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:07 smithi135 ceph-mon[89112]: osdmap e171: 8 total, 8 up, 8 in 2024-09-17T01:13:07.570 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:07 smithi071 ceph-mon[96259]: osdmap e171: 8 total, 8 up, 8 in 2024-09-17T01:13:07.571 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:07 smithi071 ceph-mon[105664]: osdmap e171: 8 total, 8 up, 8 in 2024-09-17T01:13:08.548 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:08 smithi071 ceph-mon[96259]: pgmap v271: 161 pgs: 15 peering, 24 active+undersized, 16 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-09-17T01:13:08.548 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:08 smithi071 ceph-mon[105664]: pgmap v271: 161 pgs: 15 peering, 24 active+undersized, 16 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-09-17T01:13:08.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:08 smithi135 ceph-mon[89112]: pgmap v271: 161 pgs: 15 peering, 24 active+undersized, 16 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-09-17T01:13:09.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: pgmap v272: 161 pgs: 15 peering, 23 active+undersized, 16 active+undersized+degraded, 107 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-09-17T01:13:09.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: Upgrade: Updating osd.6 2024-09-17T01:13:09.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:13:09.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:09.794 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:09 smithi135 ceph-mon[89112]: Deploying daemon osd.6 on smithi135 2024-09-17T01:13:09.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: pgmap v272: 161 pgs: 15 peering, 23 active+undersized, 16 active+undersized+degraded, 107 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: Upgrade: Updating osd.6 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[96259]: Deploying daemon osd.6 on smithi135 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:09.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: pgmap v272: 161 pgs: 15 peering, 23 active+undersized, 16 active+undersized+degraded, 107 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 58/726 objects degraded (7.989%) 2024-09-17T01:13:09.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: Upgrade: Updating osd.6 2024-09-17T01:13:09.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-17T01:13:09.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:09.908 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:09 smithi071 ceph-mon[105664]: Deploying daemon osd.6 on smithi135 2024-09-17T01:13:10.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:10 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:10.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:10 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:10 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:10.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:10 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:10 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:10.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:10 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:11.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:11 smithi135 ceph-mon[89112]: pgmap v273: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:13:12.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:11 smithi071 ceph-mon[96259]: pgmap v273: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:13:12.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:11 smithi071 ceph-mon[105664]: pgmap v273: 161 pgs: 6 peering, 155 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:13:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:12 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded) 2024-09-17T01:13:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:12 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:13:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:12.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:12 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded) 2024-09-17T01:13:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:13:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:13.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/726 objects degraded (7.989%), 16 pgs degraded) 2024-09-17T01:13:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:13:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:13.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:12 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.694 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:14 smithi135 ceph-mon[89112]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:14.694 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.694 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.694 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[96259]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:14.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[105664]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:14.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:15.250 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:14 smithi135 systemd[1]: Stopping Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:13:15.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:15 smithi135 ceph-mon[89112]: osd.6 marked itself down and dead 2024-09-17T01:13:15.710 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[124973]: 2024-09-17T01:13:15.251+0000 7f81456d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:13:15.710 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[124973]: 2024-09-17T01:13:15.251+0000 7f81456d0640 -1 osd.6 171 *** Got signal Terminated *** 2024-09-17T01:13:15.710 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[124973]: 2024-09-17T01:13:15.251+0000 7f81456d0640 -1 osd.6 171 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:13:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:15 smithi071 ceph-mon[96259]: osd.6 marked itself down and dead 2024-09-17T01:13:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:15 smithi071 ceph-mon[105664]: osd.6 marked itself down and dead 2024-09-17T01:13:16.066 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:15 smithi135 podman[128598]: 2024-09-17 01:13:15.806774358 +0000 UTC m=+0.682459767 container died c26c6210123c49476d40f01f57ae4d0e1ca2d0b8a4306a1273230ab1b25bb937 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-17T01:13:16.406 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:16 smithi135 podman[128598]: 2024-09-17 01:13:16.27677275 +0000 UTC m=+1.152458158 container cleanup c26c6210123c49476d40f01f57ae4d0e1ca2d0b8a4306a1273230ab1b25bb937 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:13:16.406 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:16 smithi135 bash[128598]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6 2024-09-17T01:13:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:16 smithi135 ceph-mon[89112]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 416 B/s rd, 0 op/s 2024-09-17T01:13:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:16 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:16.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:16 smithi135 ceph-mon[89112]: osdmap e172: 8 total, 7 up, 8 in 2024-09-17T01:13:16.710 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:16 smithi135 podman[128614]: 2024-09-17 01:13:16.5953323 +0000 UTC m=+0.784640933 container remove c26c6210123c49476d40f01f57ae4d0e1ca2d0b8a4306a1273230ab1b25bb937 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T01:13:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:16 smithi071 ceph-mon[105664]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 416 B/s rd, 0 op/s 2024-09-17T01:13:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:16 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:16 smithi071 ceph-mon[105664]: osdmap e172: 8 total, 7 up, 8 in 2024-09-17T01:13:16.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:16 smithi071 ceph-mon[96259]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 416 B/s rd, 0 op/s 2024-09-17T01:13:16.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:16 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:16.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:16 smithi071 ceph-mon[96259]: osdmap e172: 8 total, 7 up, 8 in 2024-09-17T01:13:17.095 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:13:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:13:16] "GET /metrics HTTP/1.1" 200 38488 "" "Prometheus/2.43.0" 2024-09-17T01:13:17.095 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:16 smithi135 podman[128711]: 2024-09-17 01:13:16.866193398 +0000 UTC m=+0.019278544 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:13:17.095 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:16 smithi135 podman[128711]: 2024-09-17 01:13:16.979455808 +0000 UTC m=+0.132540939 container create b9d720bf53119a718e138bbe0a244b0208352de0518278c8e81719208d06c339 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-17T01:13:17.413 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:17 smithi135 podman[128711]: 2024-09-17 01:13:17.223987915 +0000 UTC m=+0.377073048 container init b9d720bf53119a718e138bbe0a244b0208352de0518278c8e81719208d06c339 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97) 2024-09-17T01:13:17.413 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:17 smithi135 podman[128711]: 2024-09-17 01:13:17.227603462 +0000 UTC m=+0.380688594 container start b9d720bf53119a718e138bbe0a244b0208352de0518278c8e81719208d06c339 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97) 2024-09-17T01:13:17.413 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:17 smithi135 podman[128711]: 2024-09-17 01:13:17.306985871 +0000 UTC m=+0.460071039 container attach b9d720bf53119a718e138bbe0a244b0208352de0518278c8e81719208d06c339 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T01:13:17.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:17 smithi135 ceph-mon[89112]: osdmap e173: 8 total, 7 up, 8 in 2024-09-17T01:13:17.710 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:17 smithi135 podman[128711]: 2024-09-17 01:13:17.416082892 +0000 UTC m=+0.569168057 container died b9d720bf53119a718e138bbe0a244b0208352de0518278c8e81719208d06c339 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:13:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:17 smithi071 ceph-mon[96259]: osdmap e173: 8 total, 7 up, 8 in 2024-09-17T01:13:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:17 smithi071 ceph-mon[105664]: osdmap e173: 8 total, 7 up, 8 in 2024-09-17T01:13:18.455 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 podman[128735]: 2024-09-17 01:13:18.127810458 +0000 UTC m=+0.705537471 container remove b9d720bf53119a718e138bbe0a244b0208352de0518278c8e81719208d06c339 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:13:18.455 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.6.service: Deactivated successfully. 2024-09-17T01:13:18.455 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 systemd[1]: Stopped Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:13:18.455 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.6.service: Consumed 1.758s CPU time. 2024-09-17T01:13:18.456 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 systemd[1]: Starting Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:13:18.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:18 smithi135 ceph-mon[89112]: pgmap v278: 161 pgs: 15 peering, 13 stale+active+clean, 133 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:18.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:18.706 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:18.706 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 podman[128833]: 2024-09-17 01:13:18.465626785 +0000 UTC m=+0.016716279 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:13:18.706 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 podman[128833]: 2024-09-17 01:13:18.596148646 +0000 UTC m=+0.147238179 container create b0f6d0eb3697737a129e795594fe57fff520d2bc0a6a6bbbc6c40c82a34a66e2 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-17T01:13:18.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:18 smithi071 ceph-mon[96259]: pgmap v278: 161 pgs: 15 peering, 13 stale+active+clean, 133 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:18.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:18.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:18 smithi071 ceph-mon[105664]: pgmap v278: 161 pgs: 15 peering, 13 stale+active+clean, 133 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 podman[128833]: 2024-09-17 01:13:18.789748947 +0000 UTC m=+0.340838436 container init b0f6d0eb3697737a129e795594fe57fff520d2bc0a6a6bbbc6c40c82a34a66e2 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T01:13:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 podman[128833]: 2024-09-17 01:13:18.793330396 +0000 UTC m=+0.344419890 container start b0f6d0eb3697737a129e795594fe57fff520d2bc0a6a6bbbc6c40c82a34a66e2 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T01:13:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 podman[128833]: 2024-09-17 01:13:18.873165793 +0000 UTC m=+0.424255296 container attach b0f6d0eb3697737a129e795594fe57fff520d2bc0a6a6bbbc6c40c82a34a66e2 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-17T01:13:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 bash[128833]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:18 smithi135 bash[128833]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:19.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:13:19.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 bash[128833]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:13:19.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:19.961 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 bash[128833]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 bash[128833]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 bash[128833]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 bash[128833]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 bash[128833]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:13:20.324 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate[128849]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-17T01:13:20.325 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:19 smithi135 bash[128833]: --> ceph-volume raw activate successful for osd ID: 6 2024-09-17T01:13:20.325 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:20 smithi135 podman[128833]: 2024-09-17 01:13:20.014675907 +0000 UTC m=+1.565765398 container died b0f6d0eb3697737a129e795594fe57fff520d2bc0a6a6bbbc6c40c82a34a66e2 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-17T01:13:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:20 smithi135 ceph-mon[89112]: pgmap v279: 161 pgs: 2 active+undersized, 15 peering, 11 stale+active+clean, 1 active+undersized+degraded, 132 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 2/726 objects degraded (0.275%) 2024-09-17T01:13:20.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:20 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 2/726 objects degraded (0.275%), 1 pg degraded (PG_DEGRADED) 2024-09-17T01:13:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:20 smithi071 ceph-mon[96259]: pgmap v279: 161 pgs: 2 active+undersized, 15 peering, 11 stale+active+clean, 1 active+undersized+degraded, 132 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 2/726 objects degraded (0.275%) 2024-09-17T01:13:20.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:20 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 2/726 objects degraded (0.275%), 1 pg degraded (PG_DEGRADED) 2024-09-17T01:13:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:20 smithi071 ceph-mon[105664]: pgmap v279: 161 pgs: 2 active+undersized, 15 peering, 11 stale+active+clean, 1 active+undersized+degraded, 132 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 2/726 objects degraded (0.275%) 2024-09-17T01:13:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:20 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 2/726 objects degraded (0.275%), 1 pg degraded (PG_DEGRADED) 2024-09-17T01:13:20.983 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:20 smithi135 podman[128980]: 2024-09-17 01:13:20.727341305 +0000 UTC m=+0.706160957 container remove b0f6d0eb3697737a129e795594fe57fff520d2bc0a6a6bbbc6c40c82a34a66e2 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-activate, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T01:13:20.984 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:20 smithi135 podman[129040]: 2024-09-17 01:13:20.836461051 +0000 UTC m=+0.016462316 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:13:20.984 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:20 smithi135 podman[129040]: 2024-09-17 01:13:20.986652 +0000 UTC m=+0.166653260 container create aed6d465c455efbd7e7471b9acccae2e326629891d525f49c34e28c35f236377 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_CLEAN=True, ceph=True) 2024-09-17T01:13:21.261 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:21 smithi135 podman[129040]: 2024-09-17 01:13:21.205589771 +0000 UTC m=+0.385591041 container init aed6d465c455efbd7e7471b9acccae2e326629891d525f49c34e28c35f236377 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:13:21.261 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:21 smithi135 podman[129040]: 2024-09-17 01:13:21.208990153 +0000 UTC m=+0.388991417 container start aed6d465c455efbd7e7471b9acccae2e326629891d525f49c34e28c35f236377 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T01:13:21.261 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-osd[129059]: -- 172.21.15.135:0/154052663 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ebd55da40 con 0x555ebd53bc00 2024-09-17T01:13:21.579 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:21 smithi135 bash[129040]: aed6d465c455efbd7e7471b9acccae2e326629891d525f49c34e28c35f236377 2024-09-17T01:13:21.579 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:21 smithi135 systemd[1]: Started Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:13:21.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:21.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:21.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:21.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:21.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: pgmap v280: 161 pgs: 29 active+undersized, 6 peering, 2 stale+active+clean, 18 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 74/726 objects degraded (10.193%) 2024-09-17T01:13:22.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: pgmap v280: 161 pgs: 29 active+undersized, 6 peering, 2 stale+active+clean, 18 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 74/726 objects degraded (10.193%) 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: pgmap v280: 161 pgs: 29 active+undersized, 6 peering, 2 stale+active+clean, 18 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 74/726 objects degraded (10.193%) 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:13:23.107+0000 7efdd44d4640 -1 Falling back to public interface 2024-09-17T01:13:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.905 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:13:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:23.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:23.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:23.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:23.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:23.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 15s ago 20m - - 2024-09-17T01:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 11s ago 20m - - 2024-09-17T01:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (10m) 15s ago 15m 25.6M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (9m) 11s ago 15m 53.7M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:13:24.587 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (8m) 15s ago 13m 61.6M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (9m) 11s ago 19m 526M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (7m) 15s ago 21m 443M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (6m) 15s ago 21m 69.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (5m) 11s ago 20m 50.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (6m) 15s ago 20m 57.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (10m) 15s ago 16m 15.0M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (9m) 11s ago 16m 16.5M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (4m) 15s ago 19m 55.8M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (3m) 15s ago 19m 59.4M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (3m) 15s ago 18m 48.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (2m) 15s ago 18m 49.6M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (90s) 11s ago 18m 56.3M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:13:24.588 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (56s) 11s ago 17m 53.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d0a342ff9876 2024-09-17T01:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 starting - - - 4096M 2024-09-17T01:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (16m) 11s ago 16m 67.5M 4096M 17.2.0 e1d6a67b021e 6d86ea021ad5 2024-09-17T01:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (8m) 11s ago 16m 66.0M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (14m) 15s ago 14m 77.5M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (14m) 11s ago 14m 76.0M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (14m) 15s ago 14m 76.3M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:13:24.589 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (14m) 11s ago 14m 76.6M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:13:24.853 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.853 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.853 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.853 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: pgmap v281: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.854 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.855 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.856 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: pgmap v281: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: pgmap v281: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:24.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:24.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:24.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:24.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:24.999 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:13:24.999 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:13:24.999 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:13:24.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 11 2024-09-17T01:13:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:13:25.001 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:13:25.347 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "11/23 daemons upgraded", 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:13:25.348 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:13:25.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='client.64558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1866165680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:25.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='client.64558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1866165680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.653 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.654 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.770 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded 2024-09-17T01:13:25.770 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: osd.6 (root=default,host=smithi135) is down 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 1.0 is active+undersized+degraded, acting [7,0] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.7 is active+undersized+degraded, acting [1,2] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1b is active+undersized+degraded, acting [3,7] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.0 is active+undersized+degraded, acting [1,2] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.a is active+undersized+degraded, acting [4,1] 2024-09-17T01:13:25.771 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.c is active+undersized+degraded, acting [5,3] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.d is active+undersized+degraded, acting [7,5] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.10 is active+undersized+degraded, acting [0,5] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.11 is active+undersized+degraded, acting [7,4] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1d is active+undersized+degraded, acting [5,4] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.1f is active+undersized+degraded, acting [5,2] 2024-09-17T01:13:25.772 INFO:teuthology.orchestra.run.smithi071.stdout: pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-17T01:13:25.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='client.64558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1866165680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 87/726 objects degraded (11.983%), 21 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:25.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:25.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.710 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:13:26.427+0000 7efdd44d4640 -1 osd.6 171 log_to_monitors true 2024-09-17T01:13:26.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: pgmap v282: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 211 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='client.64582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1244200782' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: pgmap v282: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 211 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='client.64582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1244200782' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: pgmap v282: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 211 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='client.64582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1244200782' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:26.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:13:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:13:26] "GET /metrics HTTP/1.1" 200 38498 "" "Prometheus/2.43.0" 2024-09-17T01:13:27.591 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:13:27.369+0000 7efdcc27f640 -1 osd.6 171 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.844 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.845 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.845 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.845 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.845 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.845 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.845 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.845 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.846 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.847 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: osdmap e174: 8 total, 7 up, 8 in 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.848 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.849 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: osdmap e174: 8 total, 7 up, 8 in 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: osdmap e174: 8 total, 7 up, 8 in 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:27.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:27.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:27.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:27.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:27.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: pgmap v283: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.699 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.700 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.701 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446] boot 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: osdmap e175: 8 total, 8 up, 8 in 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.702 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.703 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.703 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.703 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.862 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: pgmap v283: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.863 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.864 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: pgmap v283: 161 pgs: 34 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.865 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.866 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.867 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446] boot 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: osdmap e175: 8 total, 8 up, 8 in 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.868 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: osd.6 [v2:172.21.15.135:6816/3328400446,v1:172.21.15.135:6817/3328400446] boot 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: osdmap e175: 8 total, 8 up, 8 in 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.870 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:28.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:28.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:28.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:28.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:28.871 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.893 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.894 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.895 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.896 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: osdmap e176: 8 total, 8 up, 8 in 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.897 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: osdmap e176: 8 total, 8 up, 8 in 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: osdmap e176: 8 total, 8 up, 8 in 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:29.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:29.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:29.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:29.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: pgmap v286: 161 pgs: 1 peering, 33 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: pgmap v286: 161 pgs: 1 peering, 33 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:30.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: pgmap v286: 161 pgs: 1 peering, 33 active+undersized, 21 active+undersized+degraded, 106 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 87/726 objects degraded (11.983%) 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:30.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:31.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:31 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:31.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:31 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: pgmap v288: 161 pgs: 3 peering, 11 active+undersized, 8 active+undersized+degraded, 139 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 28/726 objects degraded (3.857%) 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.608 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.609 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: pgmap v288: 161 pgs: 3 peering, 11 active+undersized, 8 active+undersized+degraded, 139 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 28/726 objects degraded (3.857%) 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.610 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.611 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 28/726 objects degraded (3.857%), 8 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:32.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.613 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.614 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: pgmap v288: 161 pgs: 3 peering, 11 active+undersized, 8 active+undersized+degraded, 139 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 28/726 objects degraded (3.857%) 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.790 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 28/726 objects degraded (3.857%), 8 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:32.791 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.792 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.793 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:32 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 28/726 objects degraded (3.857%), 8 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:32.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:32.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:32 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.882 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.883 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.884 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.889 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:33.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:33.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:33.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:33.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:33.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:33.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:34.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: pgmap v289: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/726 objects degraded (3.857%), 8 pgs degraded) 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: pgmap v289: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/726 objects degraded (3.857%), 8 pgs degraded) 2024-09-17T01:13:34.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:34 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:13:34.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: pgmap v289: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:34.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:34.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/726 objects degraded (3.857%), 8 pgs degraded) 2024-09-17T01:13:34.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:34 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:13:35.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:35 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:35.809 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:35 smithi135 ceph-mon[89112]: Upgrade: osd.7 is safe to restart 2024-09-17T01:13:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:35 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:35 smithi071 ceph-mon[96259]: Upgrade: osd.7 is safe to restart 2024-09-17T01:13:35.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:35 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:35.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:35 smithi071 ceph-mon[105664]: Upgrade: osd.7 is safe to restart 2024-09-17T01:13:36.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 658 B/s rd, 0 op/s 2024-09-17T01:13:36.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: Upgrade: Updating osd.7 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[105664]: Deploying daemon osd.7 on smithi135 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 658 B/s rd, 0 op/s 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: Upgrade: Updating osd.7 2024-09-17T01:13:36.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:13:36.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:36.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:36 smithi071 ceph-mon[96259]: Deploying daemon osd.7 on smithi135 2024-09-17T01:13:36.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 658 B/s rd, 0 op/s 2024-09-17T01:13:36.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: Upgrade: Updating osd.7 2024-09-17T01:13:36.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:36.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:13:36.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:36.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-mon[89112]: Deploying daemon osd.7 on smithi135 2024-09-17T01:13:36.916 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:13:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:13:36] "GET /metrics HTTP/1.1" 200 38501 "" "Prometheus/2.43.0" 2024-09-17T01:13:38.278 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:38 smithi135 ceph-mon[89112]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:38.278 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.278 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.278 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:38 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[105664]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:38.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[96259]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:13:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:38.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:38 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:40.374 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:40 smithi135 ceph-mon[89112]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:13:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:40 smithi071 ceph-mon[96259]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:13:40.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:40 smithi071 ceph-mon[105664]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-17T01:13:41.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:41 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:41.491 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:41 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:41.491 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:41 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:42.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:42 smithi135 ceph-mon[89112]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:13:42.461 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:42 smithi135 systemd[1]: Stopping Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:13:42.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:42 smithi071 ceph-mon[96259]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:13:42.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:42 smithi071 ceph-mon[105664]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-17T01:13:42.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:42 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[38091]: 2024-09-17T01:13:42.520+0000 7fe578d8c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:13:42.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:42 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[38091]: 2024-09-17T01:13:42.520+0000 7fe578d8c700 -1 osd.7 176 *** Got signal Terminated *** 2024-09-17T01:13:42.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:42 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[38091]: 2024-09-17T01:13:42.520+0000 7fe578d8c700 -1 osd.7 176 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:13:43.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:43 smithi135 ceph-mon[89112]: osd.7 marked itself down and dead 2024-09-17T01:13:43.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:43 smithi071 ceph-mon[96259]: osd.7 marked itself down and dead 2024-09-17T01:13:43.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:43 smithi071 ceph-mon[105664]: osd.7 marked itself down and dead 2024-09-17T01:13:43.919 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:43 smithi135 podman[134385]: 2024-09-17 01:13:43.647376443 +0000 UTC m=+1.249729798 container died 6d86ea021ad51bf8e68621f387bac913b7fd22170fea3e12e0edfc67d455cc06 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.expose-services=, name=centos-stream, vendor=Red Hat, Inc., RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, version=8, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, release=754) 2024-09-17T01:13:44.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:44 smithi135 podman[134385]: 2024-09-17 01:13:44.021514969 +0000 UTC m=+1.623868316 container cleanup 6d86ea021ad51bf8e68621f387bac913b7fd22170fea3e12e0edfc67d455cc06 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, maintainer=Guillaume Abrioux , version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_BRANCH=HEAD, GIT_CLEAN=True, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, io.openshift.expose-services=, io.buildah.version=1.19.8, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-09-17T01:13:44.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:44 smithi135 bash[134385]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7 2024-09-17T01:13:44.627 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:44 smithi135 ceph-mon[89112]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-17T01:13:44.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:44 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:44.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:44 smithi135 ceph-mon[89112]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:13:44.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:44 smithi135 ceph-mon[89112]: osdmap e177: 8 total, 7 up, 8 in 2024-09-17T01:13:44.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:44 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:44.628 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:44 smithi135 podman[134402]: 2024-09-17 01:13:44.306265253 +0000 UTC m=+0.661406459 container remove 6d86ea021ad51bf8e68621f387bac913b7fd22170fea3e12e0edfc67d455cc06 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, release=754, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, version=8, com.redhat.component=centos-stream-container, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, ceph=True) 2024-09-17T01:13:44.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[96259]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-17T01:13:44.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:44.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[96259]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:13:44.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[96259]: osdmap e177: 8 total, 7 up, 8 in 2024-09-17T01:13:44.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:44.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[105664]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-17T01:13:44.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:13:44.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[105664]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:13:44.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[105664]: osdmap e177: 8 total, 7 up, 8 in 2024-09-17T01:13:44.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:44 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:44.940 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:44 smithi135 podman[134491]: 2024-09-17 01:13:44.533248358 +0000 UTC m=+0.016141703 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:13:44.940 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:44 smithi135 podman[134491]: 2024-09-17 01:13:44.699079748 +0000 UTC m=+0.181973088 container create 3aa862eb8bad4bbfdb86d8eef235a7a56e82b9eb9e94e6c63389fa6e6d5593b1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T01:13:44.941 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:44 smithi135 podman[134491]: 2024-09-17 01:13:44.943507473 +0000 UTC m=+0.426400818 container init 3aa862eb8bad4bbfdb86d8eef235a7a56e82b9eb9e94e6c63389fa6e6d5593b1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-17T01:13:45.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:44 smithi135 podman[134491]: 2024-09-17 01:13:44.947080233 +0000 UTC m=+0.429973575 container start 3aa862eb8bad4bbfdb86d8eef235a7a56e82b9eb9e94e6c63389fa6e6d5593b1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:13:45.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:45 smithi135 podman[134491]: 2024-09-17 01:13:45.035227526 +0000 UTC m=+0.518120862 container attach 3aa862eb8bad4bbfdb86d8eef235a7a56e82b9eb9e94e6c63389fa6e6d5593b1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-c2ddf97, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-17T01:13:45.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:45 smithi135 podman[134491]: 2024-09-17 01:13:45.144004161 +0000 UTC m=+0.626897498 container died 3aa862eb8bad4bbfdb86d8eef235a7a56e82b9eb9e94e6c63389fa6e6d5593b1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:13:45.595 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:45 smithi135 ceph-mon[89112]: osdmap e178: 8 total, 7 up, 8 in 2024-09-17T01:13:45.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:45 smithi071 ceph-mon[96259]: osdmap e178: 8 total, 7 up, 8 in 2024-09-17T01:13:45.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:45 smithi071 ceph-mon[105664]: osdmap e178: 8 total, 7 up, 8 in 2024-09-17T01:13:45.875 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:45 smithi135 podman[134514]: 2024-09-17 01:13:45.763901479 +0000 UTC m=+0.613463082 container remove 3aa862eb8bad4bbfdb86d8eef235a7a56e82b9eb9e94e6c63389fa6e6d5593b1 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:13:45.876 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:45 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.7.service: Deactivated successfully. 2024-09-17T01:13:45.876 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:45 smithi135 systemd[1]: Stopped Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:13:45.876 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:45 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.7.service: Consumed 12.811s CPU time. 2024-09-17T01:13:46.200 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:45 smithi135 systemd[1]: Starting Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:13:46.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:46 smithi135 ceph-mon[89112]: pgmap v297: 161 pgs: 7 active+undersized, 12 peering, 13 stale+active+clean, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:13:46.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:46 smithi135 ceph-mon[89112]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-17T01:13:46.461 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 podman[134622]: 2024-09-17 01:13:46.106077796 +0000 UTC m=+0.015997715 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:13:46.461 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 podman[134622]: 2024-09-17 01:13:46.206434146 +0000 UTC m=+0.116354065 container create 8424787e32e5893cb227225534bee862ba3b646938500ff700948b1c15526d84 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:13:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:46 smithi071 ceph-mon[96259]: pgmap v297: 161 pgs: 7 active+undersized, 12 peering, 13 stale+active+clean, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:13:46.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:46 smithi071 ceph-mon[96259]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-17T01:13:46.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:46 smithi071 ceph-mon[105664]: pgmap v297: 161 pgs: 7 active+undersized, 12 peering, 13 stale+active+clean, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:13:46.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:46 smithi071 ceph-mon[105664]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-17T01:13:46.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 podman[134622]: 2024-09-17 01:13:46.492495066 +0000 UTC m=+0.402414984 container init 8424787e32e5893cb227225534bee862ba3b646938500ff700948b1c15526d84 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:13:46.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 podman[134622]: 2024-09-17 01:13:46.496431346 +0000 UTC m=+0.406351274 container start 8424787e32e5893cb227225534bee862ba3b646938500ff700948b1c15526d84 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:13:46.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 podman[134622]: 2024-09-17 01:13:46.592437415 +0000 UTC m=+0.502357349 container attach 8424787e32e5893cb227225534bee862ba3b646938500ff700948b1c15526d84 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:13:46.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:46.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 bash[134622]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:46.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:46.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:46 smithi135 bash[134622]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:13:47.102 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:13:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:13:46] "GET /metrics HTTP/1.1" 200 38501 "" "Prometheus/2.43.0" 2024-09-17T01:13:47.102 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:13:47.103 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 bash[134622]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:13:47.390 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 82/726 objects degraded (11.295%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:47.391 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:13:47.391 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 bash[134622]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:13:47.391 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:13:47.391 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 bash[134622]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:13:47.612 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:47 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 82/726 objects degraded (11.295%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:47.612 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:47 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 82/726 objects degraded (11.295%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:47.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:13:47.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 bash[134622]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:13:47.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-17T01:13:47.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 bash[134622]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-17T01:13:47.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:13:47.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 bash[134622]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:13:47.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[134637]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-17T01:13:47.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 bash[134622]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-17T01:13:47.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:47 smithi135 podman[134622]: 2024-09-17 01:13:47.42158969 +0000 UTC m=+1.331509609 container died 8424787e32e5893cb227225534bee862ba3b646938500ff700948b1c15526d84 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-17T01:13:48.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:48 smithi071 ceph-mon[96259]: pgmap v298: 161 pgs: 22 active+undersized, 12 peering, 4 stale+active+clean, 19 active+undersized+degraded, 104 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 82/726 objects degraded (11.295%) 2024-09-17T01:13:48.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:48 smithi071 ceph-mon[105664]: pgmap v298: 161 pgs: 22 active+undersized, 12 peering, 4 stale+active+clean, 19 active+undersized+degraded, 104 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 82/726 objects degraded (11.295%) 2024-09-17T01:13:48.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:48 smithi135 ceph-mon[89112]: pgmap v298: 161 pgs: 22 active+undersized, 12 peering, 4 stale+active+clean, 19 active+undersized+degraded, 104 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 82/726 objects degraded (11.295%) 2024-09-17T01:13:48.428 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 podman[134769]: 2024-09-17 01:13:48.179976814 +0000 UTC m=+0.752381802 container remove 8424787e32e5893cb227225534bee862ba3b646938500ff700948b1c15526d84 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T01:13:48.428 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 podman[134828]: 2024-09-17 01:13:48.291714201 +0000 UTC m=+0.015802585 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:13:48.428 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 podman[134828]: 2024-09-17 01:13:48.430688898 +0000 UTC m=+0.154777271 container create f602f709bc505f67dbafbbf35d138e83f001b58a03e6dd2aa89143702d06d79b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:13:48.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 podman[134828]: 2024-09-17 01:13:48.708587863 +0000 UTC m=+0.432676235 container init f602f709bc505f67dbafbbf35d138e83f001b58a03e6dd2aa89143702d06d79b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T01:13:48.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 podman[134828]: 2024-09-17 01:13:48.712458378 +0000 UTC m=+0.436546759 container start f602f709bc505f67dbafbbf35d138e83f001b58a03e6dd2aa89143702d06d79b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:13:48.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 ceph-osd[134847]: -- 172.21.15.135:0/3004210047 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c4d58ba40 con 0x560c4e352400 2024-09-17T01:13:48.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 bash[134828]: f602f709bc505f67dbafbbf35d138e83f001b58a03e6dd2aa89143702d06d79b 2024-09-17T01:13:48.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:48 smithi135 systemd[1]: Started Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:13:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.774 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.774 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:49.774 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.774 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.775 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.778 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:49.779 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.601 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: pgmap v299: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.602 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.603 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.604 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.605 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.606 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.881 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[134842]: 2024-09-17T01:13:50.602+0000 7f1749490640 -1 Falling back to public interface 2024-09-17T01:13:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: pgmap v299: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: pgmap v299: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:50.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:50 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.462 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.463 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:51 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:51.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:51.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:51 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: pgmap v300: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:52 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: pgmap v300: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:52.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: pgmap v300: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:52.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:52.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.910 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.910 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.911 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:52.912 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:52.913 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:52 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:53 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:53.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:53 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.393 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[134842]: 2024-09-17T01:13:54.162+0000 7f1749490640 -1 osd.7 0 read_superblock omap replica is missing. 2024-09-17T01:13:54.394 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[134842]: 2024-09-17T01:13:54.194+0000 7f1749490640 -1 osd.7 176 log_to_monitors true 2024-09-17T01:13:54.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: pgmap v301: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:13:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.715 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: pgmap v301: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: pgmap v301: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:54.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:54.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:54.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:54.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:54.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.838 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[134842]: 2024-09-17T01:13:55.583+0000 7f173d233640 -1 osd.7 176 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.839 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.840 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: osdmap e179: 8 total, 7 up, 8 in 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:55.841 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.843 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:55 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: osdmap e179: 8 total, 7 up, 8 in 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: osdmap e179: 8 total, 7 up, 8 in 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:55.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:55.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:55.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:55.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:55.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:55 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.133 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 7s ago 21m - - 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 19s ago 21m - - 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (10m) 7s ago 16m 25.6M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (10m) 19s ago 16m 53.2M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (9m) 7s ago 14m 61.6M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (9m) 19s ago 20m 528M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (8m) 7s ago 22m 443M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (7m) 7s ago 22m 71.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (6m) 19s ago 20m 51.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (6m) 7s ago 20m 59.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (10m) 7s ago 16m 15.0M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:13:56.834 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (10m) 19s ago 16m 16.3M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (5m) 7s ago 20m 57.1M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (4m) 7s ago 19m 60.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (3m) 7s ago 19m 49.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (2m) 7s ago 19m 51.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (2m) 19s ago 18m 56.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (88s) 19s ago 18m 54.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d0a342ff9876 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (35s) 19s ago 17m 43.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de aed6d465c455 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 starting - - - 4096M 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (9m) 19s ago 16m 66.5M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (14m) 7s ago 14m 77.6M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (14m) 19s ago 14m 76.2M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (14m) 7s ago 14m 76.5M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:13:56.835 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (14m) 19s ago 14m 76.7M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:13:56.884 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:13:56] "GET /metrics HTTP/1.1" 200 38645 "" "Prometheus/2.43.0" 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: pgmap v303: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.885 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='osd.7 ' entity='osd.7' 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.886 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.887 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.888 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: pgmap v303: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='osd.7 ' entity='osd.7' 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: pgmap v303: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 92/726 objects degraded (12.672%) 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='osd.7 ' entity='osd.7' 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:56.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:56.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:56.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:56.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:56.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.245 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:13:57.245 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:13:57.245 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:13:57.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:57.245 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:13:57.246 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:13:57.603 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:13:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:13:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:13:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:13:57.603 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:13:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:13:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:13:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:13:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "12/23 daemons upgraded", 2024-09-17T01:13:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:13:57.604 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:13:57.604 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:13:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='client.64600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='client.64606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808] boot 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: osdmap e180: 8 total, 8 up, 8 in 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='client.64600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='client.64606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808] boot 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: osdmap e180: 8 total, 8 up, 8 in 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2126561505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:57.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[96259]: osdmap e181: 8 total, 8 up, 8 in 2024-09-17T01:13:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2126561505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:57.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:57 smithi071 ceph-mon[105664]: osdmap e181: 8 total, 8 up, 8 in 2024-09-17T01:13:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='client.64600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='client.64606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: osd.7 [v2:172.21.15.135:6824/511476808,v1:172.21.15.135:6825/511476808] boot 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: osdmap e180: 8 total, 8 up, 8 in 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2126561505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:57.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:57 smithi135 ceph-mon[89112]: osdmap e181: 8 total, 8 up, 8 in 2024-09-17T01:13:58.004 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded 2024-09-17T01:13:58.004 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:13:58.004 INFO:teuthology.orchestra.run.smithi071.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:13:58.004 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded 2024-09-17T01:13:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: pg 1.0 is active+undersized+degraded, acting [0,6] 2024-09-17T01:13:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.9 is active+undersized+degraded, acting [1,3] 2024-09-17T01:13:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-17T01:13:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-17T01:13:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.12 is active+undersized+degraded, acting [5,3] 2024-09-17T01:13:58.005 INFO:teuthology.orchestra.run.smithi071.stdout: pg 2.1b is active+undersized+degraded, acting [3,6] 2024-09-17T01:13:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.7 is active+undersized+degraded, acting [3,0] 2024-09-17T01:13:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.8 is active+undersized+degraded, acting [3,1] 2024-09-17T01:13:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.9 is active+undersized+degraded, acting [4,2] 2024-09-17T01:13:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.d is active+undersized+degraded, acting [5,6] 2024-09-17T01:13:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.e is active+undersized+degraded, acting [4,1] 2024-09-17T01:13:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.f is active+undersized+degraded, acting [4,0] 2024-09-17T01:13:58.006 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.11 is active+undersized+degraded, acting [4,6] 2024-09-17T01:13:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.12 is active+undersized+degraded, acting [0,3] 2024-09-17T01:13:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.13 is active+undersized+degraded, acting [4,2] 2024-09-17T01:13:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.14 is active+undersized+degraded, acting [4,6] 2024-09-17T01:13:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.15 is active+undersized+degraded, acting [3,4] 2024-09-17T01:13:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.16 is active+undersized+degraded, acting [5,1] 2024-09-17T01:13:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: pg 3.1b is active+undersized+degraded, acting [0,4] 2024-09-17T01:13:58.007 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.0 is active+undersized+degraded, acting [3,0] 2024-09-17T01:13:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.3 is active+undersized+degraded, acting [0,5] 2024-09-17T01:13:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.14 is active+undersized+degraded, acting [3,1] 2024-09-17T01:13:58.008 INFO:teuthology.orchestra.run.smithi071.stdout: pg 4.15 is active+undersized+degraded, acting [5,3] 2024-09-17T01:13:58.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:58.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: pgmap v305: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:13:58.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:58.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: Upgrade: osd.7 is safe to restart 2024-09-17T01:13:58.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: from='client.64624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:58.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:58 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2176329509' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: pgmap v305: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: Upgrade: osd.7 is safe to restart 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: from='client.64624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2176329509' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:58.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: pgmap v305: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: Upgrade: osd.7 is safe to restart 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: from='client.64624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:13:58.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:58 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2176329509' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:13:59.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:13:59.679 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:13:59 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:59.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:13:59.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:13:59 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:13:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-17T01:13:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:13:59 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:00 smithi135 ceph-mon[89112]: pgmap v307: 161 pgs: 5 peering, 27 active+undersized, 20 active+undersized+degraded, 109 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 84/726 objects degraded (11.570%) 2024-09-17T01:14:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:00 smithi135 ceph-mon[89112]: Upgrade: Updating osd.7 2024-09-17T01:14:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:00 smithi135 ceph-mon[89112]: Deploying daemon osd.7 on smithi135 2024-09-17T01:14:00.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:00 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 84/726 objects degraded (11.570%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[96259]: pgmap v307: 161 pgs: 5 peering, 27 active+undersized, 20 active+undersized+degraded, 109 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 84/726 objects degraded (11.570%) 2024-09-17T01:14:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[96259]: Upgrade: Updating osd.7 2024-09-17T01:14:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[96259]: Deploying daemon osd.7 on smithi135 2024-09-17T01:14:00.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 84/726 objects degraded (11.570%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:00.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[105664]: pgmap v307: 161 pgs: 5 peering, 27 active+undersized, 20 active+undersized+degraded, 109 active+clean; 585 KiB data, 250 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 84/726 objects degraded (11.570%) 2024-09-17T01:14:00.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[105664]: Upgrade: Updating osd.7 2024-09-17T01:14:00.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[105664]: Deploying daemon osd.7 on smithi135 2024-09-17T01:14:00.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:00 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 84/726 objects degraded (11.570%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:01.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:01 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:01 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:01 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:02.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:02 smithi135 ceph-mon[89112]: pgmap v308: 161 pgs: 5 peering, 2 active+undersized, 1 active+undersized+degraded, 153 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 2/726 objects degraded (0.275%) 2024-09-17T01:14:02.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:02 smithi071 ceph-mon[96259]: pgmap v308: 161 pgs: 5 peering, 2 active+undersized, 1 active+undersized+degraded, 153 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 2/726 objects degraded (0.275%) 2024-09-17T01:14:02.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:02 smithi071 ceph-mon[105664]: pgmap v308: 161 pgs: 5 peering, 2 active+undersized, 1 active+undersized+degraded, 153 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s; 2/726 objects degraded (0.275%) 2024-09-17T01:14:04.596 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:04 smithi135 ceph-mon[89112]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:14:04.597 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:04.597 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:04 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:04.597 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:04 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/726 objects degraded (0.275%), 1 pg degraded) 2024-09-17T01:14:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[105664]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:14:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:04.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:04.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/726 objects degraded (0.275%), 1 pg degraded) 2024-09-17T01:14:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[96259]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:14:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:04.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:04 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/726 objects degraded (0.275%), 1 pg degraded) 2024-09-17T01:14:06.106 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.107 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.107 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.107 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-mon[89112]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 718 B/s rd, 0 op/s 2024-09-17T01:14:06.107 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.107 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.107 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[96259]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 718 B/s rd, 0 op/s 2024-09-17T01:14:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[105664]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 718 B/s rd, 0 op/s 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:06 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:06.460 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:06 smithi135 systemd[1]: Stopping Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:14:06.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[134842]: 2024-09-17T01:14:06.511+0000 7f1746428640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:14:06.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[134842]: 2024-09-17T01:14:06.511+0000 7f1746428640 -1 osd.7 181 *** Got signal Terminated *** 2024-09-17T01:14:06.773 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[134842]: 2024-09-17T01:14:06.511+0000 7f1746428640 -1 osd.7 181 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:14:07.106 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:14:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:14:06] "GET /metrics HTTP/1.1" 200 38656 "" "Prometheus/2.43.0" 2024-09-17T01:14:07.388 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:07 smithi071 ceph-mon[105664]: osd.7 marked itself down and dead 2024-09-17T01:14:07.388 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:07 smithi071 ceph-mon[96259]: osd.7 marked itself down and dead 2024-09-17T01:14:07.449 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:07 smithi135 ceph-mon[89112]: osd.7 marked itself down and dead 2024-09-17T01:14:07.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:07 smithi135 podman[139088]: 2024-09-17 01:14:07.452265548 +0000 UTC m=+1.082165586 container died f602f709bc505f67dbafbbf35d138e83f001b58a03e6dd2aa89143702d06d79b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-09-17T01:14:08.107 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:07 smithi135 podman[139088]: 2024-09-17 01:14:07.904823863 +0000 UTC m=+1.534723889 container cleanup f602f709bc505f67dbafbbf35d138e83f001b58a03e6dd2aa89143702d06d79b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T01:14:08.108 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:07 smithi135 bash[139088]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7 2024-09-17T01:14:08.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:08 smithi071 ceph-mon[105664]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:14:08.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:08 smithi071 ceph-mon[105664]: osdmap e182: 8 total, 7 up, 8 in 2024-09-17T01:14:08.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:08 smithi071 ceph-mon[105664]: pgmap v312: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:14:08.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:08 smithi071 ceph-mon[96259]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:14:08.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:08 smithi071 ceph-mon[96259]: osdmap e182: 8 total, 7 up, 8 in 2024-09-17T01:14:08.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:08 smithi071 ceph-mon[96259]: pgmap v312: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:14:08.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:08 smithi135 ceph-mon[89112]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:14:08.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:08 smithi135 ceph-mon[89112]: osdmap e182: 8 total, 7 up, 8 in 2024-09-17T01:14:08.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:08 smithi135 ceph-mon[89112]: pgmap v312: 161 pgs: 19 stale+active+clean, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:14:08.460 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:08 smithi135 podman[139104]: 2024-09-17 01:14:08.282571543 +0000 UTC m=+0.821262645 container remove f602f709bc505f67dbafbbf35d138e83f001b58a03e6dd2aa89143702d06d79b (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T01:14:08.892 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:08 smithi135 podman[139196]: 2024-09-17 01:14:08.502332178 +0000 UTC m=+0.016063373 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:14:08.892 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:08 smithi135 podman[139196]: 2024-09-17 01:14:08.692183379 +0000 UTC m=+0.205914564 container create 2a8ff7e76914eda6e5dba05271ea13994f649cb7b8a8b5f342d597e060cfc436 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:14:08.892 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:08 smithi135 podman[139196]: 2024-09-17 01:14:08.894908646 +0000 UTC m=+0.408639833 container init 2a8ff7e76914eda6e5dba05271ea13994f649cb7b8a8b5f342d597e060cfc436 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=) 2024-09-17T01:14:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:09 smithi135 ceph-mon[89112]: osdmap e183: 8 total, 7 up, 8 in 2024-09-17T01:14:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.211 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:08 smithi135 podman[139196]: 2024-09-17 01:14:08.898437897 +0000 UTC m=+0.412169076 container start 2a8ff7e76914eda6e5dba05271ea13994f649cb7b8a8b5f342d597e060cfc436 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:14:09.211 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:08 smithi135 podman[139196]: 2024-09-17 01:14:08.970016897 +0000 UTC m=+0.483748078 container attach 2a8ff7e76914eda6e5dba05271ea13994f649cb7b8a8b5f342d597e060cfc436 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-17T01:14:09.211 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:09 smithi135 podman[139196]: 2024-09-17 01:14:09.079844428 +0000 UTC m=+0.593575620 container died 2a8ff7e76914eda6e5dba05271ea13994f649cb7b8a8b5f342d597e060cfc436 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:14:09.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[96259]: osdmap e183: 8 total, 7 up, 8 in 2024-09-17T01:14:09.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[105664]: osdmap e183: 8 total, 7 up, 8 in 2024-09-17T01:14:09.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:09.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:09 smithi135 podman[139219]: 2024-09-17 01:14:09.708709096 +0000 UTC m=+0.623144076 container remove 2a8ff7e76914eda6e5dba05271ea13994f649cb7b8a8b5f342d597e060cfc436 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:14:09.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:09 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.7.service: Deactivated successfully. 2024-09-17T01:14:09.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:09 smithi135 systemd[1]: Stopped Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:14:09.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:09 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.7.service: Consumed 2.050s CPU time. 2024-09-17T01:14:09.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:09 smithi135 systemd[1]: Starting Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:14:10.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:10 smithi071 ceph-mon[96259]: pgmap v314: 161 pgs: 8 active+undersized, 5 peering, 17 stale+active+clean, 4 active+undersized+degraded, 127 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 10/726 objects degraded (1.377%) 2024-09-17T01:14:10.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:10 smithi071 ceph-mon[105664]: pgmap v314: 161 pgs: 8 active+undersized, 5 peering, 17 stale+active+clean, 4 active+undersized+degraded, 127 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 10/726 objects degraded (1.377%) 2024-09-17T01:14:10.427 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:10 smithi135 ceph-mon[89112]: pgmap v314: 161 pgs: 8 active+undersized, 5 peering, 17 stale+active+clean, 4 active+undersized+degraded, 127 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 10/726 objects degraded (1.377%) 2024-09-17T01:14:10.427 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 podman[139317]: 2024-09-17 01:14:10.043705421 +0000 UTC m=+0.016756347 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:14:10.427 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 podman[139317]: 2024-09-17 01:14:10.143694385 +0000 UTC m=+0.116745333 container create 63bb3ed353f76c0b012bb77c5852700b9e9a87f5b14dac380221de4cf3f536c4 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T01:14:10.428 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 podman[139317]: 2024-09-17 01:14:10.355063648 +0000 UTC m=+0.328114586 container init 63bb3ed353f76c0b012bb77c5852700b9e9a87f5b14dac380221de4cf3f536c4 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:14:10.428 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 podman[139317]: 2024-09-17 01:14:10.358391013 +0000 UTC m=+0.331441919 container start 63bb3ed353f76c0b012bb77c5852700b9e9a87f5b14dac380221de4cf3f536c4 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T01:14:10.428 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 podman[139317]: 2024-09-17 01:14:10.43003478 +0000 UTC m=+0.403085694 container attach 63bb3ed353f76c0b012bb77c5852700b9e9a87f5b14dac380221de4cf3f536c4 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T01:14:10.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:14:10.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 bash[139317]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:14:10.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:14:10.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 bash[139317]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:14:11.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:11 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:11.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:11 smithi135 ceph-mon[89112]: Health check failed: Degraded data redundancy: 10/726 objects degraded (1.377%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:11.211 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:14:11.211 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 bash[139317]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:14:11.211 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:14:11.211 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:10 smithi135 bash[139317]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-09-17T01:14:11.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:11 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:11.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:11 smithi071 ceph-mon[105664]: Health check failed: Degraded data redundancy: 10/726 objects degraded (1.377%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:11.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:11 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:11.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:11 smithi071 ceph-mon[96259]: Health check failed: Degraded data redundancy: 10/726 objects degraded (1.377%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:11.599 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:14:11.599 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 bash[139317]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-09-17T01:14:11.599 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:14:11.599 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 bash[139317]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-17T01:14:11.600 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-17T01:14:11.600 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 bash[139317]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-17T01:14:11.600 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:14:11.600 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 bash[139317]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:14:11.600 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate[139332]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-17T01:14:11.600 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 bash[139317]: --> ceph-volume raw activate successful for osd ID: 7 2024-09-17T01:14:11.600 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 podman[139317]: 2024-09-17 01:14:11.27168452 +0000 UTC m=+1.244735442 container died 63bb3ed353f76c0b012bb77c5852700b9e9a87f5b14dac380221de4cf3f536c4 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-17T01:14:12.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:12 smithi135 ceph-mon[89112]: pgmap v315: 161 pgs: 28 active+undersized, 5 peering, 4 stale+active+clean, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 90/726 objects degraded (12.397%) 2024-09-17T01:14:12.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:11 smithi135 podman[139472]: 2024-09-17 01:14:11.927719833 +0000 UTC m=+0.650205176 container remove 63bb3ed353f76c0b012bb77c5852700b9e9a87f5b14dac380221de4cf3f536c4 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:14:12.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:12 smithi135 podman[139531]: 2024-09-17 01:14:12.042168664 +0000 UTC m=+0.016179224 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:14:12.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:12 smithi071 ceph-mon[105664]: pgmap v315: 161 pgs: 28 active+undersized, 5 peering, 4 stale+active+clean, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 90/726 objects degraded (12.397%) 2024-09-17T01:14:12.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:12 smithi071 ceph-mon[96259]: pgmap v315: 161 pgs: 28 active+undersized, 5 peering, 4 stale+active+clean, 22 active+undersized+degraded, 102 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 90/726 objects degraded (12.397%) 2024-09-17T01:14:12.504 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:12 smithi135 podman[139531]: 2024-09-17 01:14:12.228993456 +0000 UTC m=+0.203004006 container create 3327a7bed00a31a5f0565bd8381150af5079306124bb6799e1747aa6f47c60fa (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T01:14:12.504 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:12 smithi135 podman[139531]: 2024-09-17 01:14:12.448428383 +0000 UTC m=+0.422438941 container init 3327a7bed00a31a5f0565bd8381150af5079306124bb6799e1747aa6f47c60fa (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T01:14:12.504 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:12 smithi135 podman[139531]: 2024-09-17 01:14:12.451670387 +0000 UTC m=+0.425680944 container start 3327a7bed00a31a5f0565bd8381150af5079306124bb6799e1747aa6f47c60fa (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-17T01:14:12.505 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:12 smithi135 ceph-osd[139550]: -- 172.21.15.135:0/3997614624 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55754b2f9a40 con 0x55754b2d7c00 2024-09-17T01:14:12.505 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:12 smithi135 bash[139531]: 3327a7bed00a31a5f0565bd8381150af5079306124bb6799e1747aa6f47c60fa 2024-09-17T01:14:12.755 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:12 smithi135 systemd[1]: Started Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:14:13.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.827 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:13 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:13.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:13.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:13.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:13.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:13.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:13 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.460 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:14:14.353+0000 7f1404b16640 -1 Falling back to public interface 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: pgmap v316: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.820 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.821 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.822 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.823 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.824 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:14 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: pgmap v316: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: pgmap v316: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:14.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:14.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:14 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.687 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.689 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:15 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:15.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:15.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:15 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: pgmap v317: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 510 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: pgmap v317: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 510 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:16 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.939 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:14:16] "GET /metrics HTTP/1.1" 200 38656 "" "Prometheus/2.43.0" 2024-09-17T01:14:16.939 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: pgmap v317: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 510 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.942 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:16.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:16 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:17 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.923 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.924 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.925 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:17.926 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:17.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:17.927 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.192 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:14:17.934+0000 7f1404b16640 -1 osd.7 181 log_to_monitors true 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: pgmap v318: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.876 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:18.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: pgmap v318: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:18.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:14:18.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:14:18.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: pgmap v318: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:18.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-17T01:14:18.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.908 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:18.909 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:14:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:14:18.877+0000 7f13f88b9640 -1 osd.7 181 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:14:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: osdmap e184: 8 total, 7 up, 8 in 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: osdmap e184: 8 total, 7 up, 8 in 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:14:19.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:19.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: osdmap e184: 8 total, 7 up, 8 in 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-17T01:14:19.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:19.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:19.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: pgmap v320: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260] boot 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: osdmap e185: 8 total, 8 up, 8 in 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: pgmap v320: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260] boot 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: osdmap e185: 8 total, 8 up, 8 in 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:20 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: pgmap v320: 161 pgs: 39 active+undersized, 23 active+undersized+degraded, 99 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 92/726 objects degraded (12.672%) 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:20.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: osd.7 [v2:172.21.15.135:6824/4201928260,v1:172.21.15.135:6825/4201928260] boot 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: osdmap e185: 8 total, 8 up, 8 in 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 92/726 objects degraded (12.672%), 23 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:20.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:20.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:20 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:21.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: osdmap e186: 8 total, 8 up, 8 in 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: osdmap e186: 8 total, 8 up, 8 in 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.905 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:21 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: osdmap e186: 8 total, 8 up, 8 in 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:21.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:21.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:21.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:21.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:21.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:21 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.877 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: pgmap v323: 161 pgs: 22 peering, 28 active+undersized, 12 active+undersized+degraded, 99 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 50/726 objects degraded (6.887%) 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.879 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.880 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.881 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:22 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: pgmap v323: 161 pgs: 22 peering, 28 active+undersized, 12 active+undersized+degraded, 99 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 50/726 objects degraded (6.887%) 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: pgmap v323: 161 pgs: 22 peering, 28 active+undersized, 12 active+undersized+degraded, 99 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 50/726 objects degraded (6.887%) 2024-09-17T01:14:22.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:22.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:22 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.900 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:23 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.913 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.914 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.915 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:23.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:23.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:23.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:23.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:23.916 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:23 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: pgmap v324: 161 pgs: 22 peering, 21 active+undersized, 11 active+undersized+degraded, 107 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48/726 objects degraded (6.612%) 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: pgmap v324: 161 pgs: 22 peering, 21 active+undersized, 11 active+undersized+degraded, 107 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48/726 objects degraded (6.612%) 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.901 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:24 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: pgmap v324: 161 pgs: 22 peering, 21 active+undersized, 11 active+undersized+degraded, 107 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 48/726 objects degraded (6.612%) 2024-09-17T01:14:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:24.965 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:24.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:24.966 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:24 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: Health check update: Degraded data redundancy: 48/726 objects degraded (6.612%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: Health check update: Degraded data redundancy: 48/726 objects degraded (6.612%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.905 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.906 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.907 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:25 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.962 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: Health check update: Degraded data redundancy: 48/726 objects degraded (6.612%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.963 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:25.964 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:25 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: pgmap v325: 161 pgs: 22 peering, 139 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:26.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:14:26.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:14:26.714 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-mon[89112]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/726 objects degraded (6.612%), 11 pgs degraded) 2024-09-17T01:14:26.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: pgmap v325: 161 pgs: 22 peering, 139 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:26.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: pgmap v325: 161 pgs: 22 peering, 139 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 977 B/s rd, 0 op/s 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.900 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:14:26.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-17T01:14:26.902 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[96259]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/726 objects degraded (6.612%), 11 pgs degraded) 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:14:26.903 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-09-17T01:14:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-17T01:14:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-09-17T01:14:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-17T01:14:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:14:26.904 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:26 smithi071 ceph-mon[105664]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/726 objects degraded (6.612%), 11 pgs degraded) 2024-09-17T01:14:27.086 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:14:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:14:26] "GET /metrics HTTP/1.1" 200 38664 "" "Prometheus/2.43.0" 2024-09-17T01:14:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: Upgrade: Setting container_image for all osd 2024-09-17T01:14:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:14:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: Cluster is now healthy 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: osdmap e187: 8 total, 8 up, 8 in 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: Upgrade: Setting container_image for all osd 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: Cluster is now healthy 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: osdmap e187: 8 total, 8 up, 8 in 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:27.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: Upgrade: Setting container_image for all osd 2024-09-17T01:14:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:14:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: Cluster is now healthy 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: osdmap e187: 8 total, 8 up, 8 in 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:27.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:28.363 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:14:28.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[105664]: Upgrade: Setting container_image for all mds 2024-09-17T01:14:28.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[105664]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T01:14:28.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:28.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:28.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:28.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[96259]: Upgrade: Setting container_image for all mds 2024-09-17T01:14:28.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[96259]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T01:14:28.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:28.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:28.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:28 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:28.943 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:28 smithi135 ceph-mon[89112]: Upgrade: Setting container_image for all mds 2024-09-17T01:14:28.944 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:28 smithi135 ceph-mon[89112]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T01:14:28.944 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:28.944 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi071.hdtkfj", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:28.944 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:28 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:29.050 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:14:29.050 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 20s ago 21m - - 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 1s ago 21m - - 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (11m) 20s ago 16m 25.6M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (10m) 1s ago 16m 53.9M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (9m) 20s ago 14m 61.6M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (10m) 1s ago 21m 530M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (8m) 20s ago 22m 443M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (7m) 20s ago 22m 73.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (6m) 1s ago 21m 56.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (7m) 20s ago 21m 60.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (11m) 20s ago 17m 15.1M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (10m) 1s ago 17m 16.4M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (5m) 20s ago 20m 57.8M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:14:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (4m) 20s ago 20m 62.1M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (4m) 20s ago 19m 51.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (3m) 20s ago 19m 53.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (2m) 1s ago 19m 59.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (2m) 1s ago 18m 56.0M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d0a342ff9876 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (68s) 1s ago 18m 44.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de aed6d465c455 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (17s) 1s ago 18m 42.7M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 3327a7bed00a 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (9m) 1s ago 17m 66.8M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (15m) 20s ago 15m 77.7M - 17.2.0 e1d6a67b021e 10a8ee6bcd42 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (15m) 1s ago 15m 76.5M - 17.2.0 e1d6a67b021e 71baf835fa9e 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (15m) 20s ago 15m 76.6M - 17.2.0 e1d6a67b021e c58bbf9ea954 2024-09-17T01:14:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (15m) 1s ago 15m 77.0M - 17.2.0 e1d6a67b021e 3bc894f53f8e 2024-09-17T01:14:29.460 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:14:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:14:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-09-17T01:14:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13 2024-09-17T01:14:29.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:14:29.462 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:14:29.808 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:14:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:14:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:14:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:14:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:14:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-17T01:14:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:14:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:14:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:14:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "13/23 daemons upgraded", 2024-09-17T01:14:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading rgw daemons", 2024-09-17T01:14:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:14:29.809 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:14:29.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[96259]: Upgrade: Updating rgw.foo.smithi071.hdtkfj (1/4) 2024-09-17T01:14:29.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[96259]: Deploying daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T01:14:29.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[96259]: from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:29.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.841 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2884608623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:29.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[105664]: Upgrade: Updating rgw.foo.smithi071.hdtkfj (1/4) 2024-09-17T01:14:29.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[105664]: Deploying daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T01:14:29.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[105664]: from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:29.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.842 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:29 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2884608623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:29 smithi135 ceph-mon[89112]: Upgrade: Updating rgw.foo.smithi071.hdtkfj (1/4) 2024-09-17T01:14:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:29 smithi135 ceph-mon[89112]: Deploying daemon rgw.foo.smithi071.hdtkfj on smithi071 2024-09-17T01:14:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:29 smithi135 ceph-mon[89112]: from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:29 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:29 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2884608623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:30.214 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_OK 2024-09-17T01:14:30.690 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:30 smithi135 ceph-mon[89112]: from='client.64648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:30.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:30 smithi135 ceph-mon[89112]: from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:30.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:30 smithi135 ceph-mon[89112]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 742 B/s rd, 0 op/s 2024-09-17T01:14:30.691 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:30 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1514638949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:14:30.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[96259]: from='client.64648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:30.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[96259]: from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:30.868 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[96259]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 742 B/s rd, 0 op/s 2024-09-17T01:14:30.869 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1514638949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:14:30.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[105664]: from='client.64648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:30.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[105664]: from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:30.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[105664]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 742 B/s rd, 0 op/s 2024-09-17T01:14:30.869 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:30 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1514638949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:14:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:31 smithi135 ceph-mon[89112]: from='client.64666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:31.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:31 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:31.849 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:31 smithi071 ceph-mon[96259]: from='client.64666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:31.849 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:31 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:31.850 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:31 smithi071 ceph-mon[105664]: from='client.64666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:14:31.850 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:31 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:32.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:32 smithi071 ceph-mon[96259]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:14:32.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:32 smithi071 ceph-mon[105664]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:14:32.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:32 smithi135 ceph-mon[89112]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:14:34.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[105664]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:14:34.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:34.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.246 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[96259]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:14:34.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:34.247 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:34 smithi135 ceph-mon[89112]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:14:34.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:34.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:34.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[105664]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 45 op/s 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[96259]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 45 op/s 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:36.357 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:36 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:36.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:36 smithi135 ceph-mon[89112]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 45 op/s 2024-09-17T01:14:36.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:36.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi071.dosgxu", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:36.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:36 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:37.160 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:14:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:14:36] "GET /metrics HTTP/1.1" 200 38656 "" "Prometheus/2.43.0" 2024-09-17T01:14:37.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:37 smithi071 ceph-mon[96259]: Upgrade: Updating rgw.smpl.smithi071.dosgxu (2/4) 2024-09-17T01:14:37.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:37 smithi071 ceph-mon[96259]: Deploying daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T01:14:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:37 smithi071 ceph-mon[105664]: Upgrade: Updating rgw.smpl.smithi071.dosgxu (2/4) 2024-09-17T01:14:37.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:37 smithi071 ceph-mon[105664]: Deploying daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T01:14:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:37 smithi135 ceph-mon[89112]: Upgrade: Updating rgw.smpl.smithi071.dosgxu (2/4) 2024-09-17T01:14:37.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:37 smithi135 ceph-mon[89112]: Deploying daemon rgw.smpl.smithi071.dosgxu on smithi071 2024-09-17T01:14:38.461 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:38 smithi135 ceph-mon[89112]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 98 B/s wr, 136 op/s 2024-09-17T01:14:38.541 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:38 smithi071 ceph-mon[96259]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 98 B/s wr, 136 op/s 2024-09-17T01:14:38.541 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:38 smithi071 ceph-mon[105664]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 98 B/s wr, 136 op/s 2024-09-17T01:14:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:40 smithi135 ceph-mon[89112]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-17T01:14:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:40.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:40 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:40 smithi071 ceph-mon[96259]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-17T01:14:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:40.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:40 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:40.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:40 smithi071 ceph-mon[105664]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-17T01:14:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:40.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:40 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:41.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:41 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:41.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:41.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:41.437 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:41 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:41.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:41.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:41.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:41.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:41.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:41.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi135.zorred", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:41.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:41 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:42.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:42 smithi135 ceph-mon[89112]: Upgrade: Updating rgw.foo.smithi135.zorred (3/4) 2024-09-17T01:14:42.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:42 smithi135 ceph-mon[89112]: Deploying daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T01:14:42.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:42 smithi135 ceph-mon[89112]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 85 B/s wr, 184 op/s 2024-09-17T01:14:42.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:42 smithi071 ceph-mon[96259]: Upgrade: Updating rgw.foo.smithi135.zorred (3/4) 2024-09-17T01:14:42.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:42 smithi071 ceph-mon[96259]: Deploying daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T01:14:42.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:42 smithi071 ceph-mon[96259]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 85 B/s wr, 184 op/s 2024-09-17T01:14:42.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:42 smithi071 ceph-mon[105664]: Upgrade: Updating rgw.foo.smithi135.zorred (3/4) 2024-09-17T01:14:42.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:42 smithi071 ceph-mon[105664]: Deploying daemon rgw.foo.smithi135.zorred on smithi135 2024-09-17T01:14:42.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:42 smithi071 ceph-mon[105664]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 85 B/s wr, 184 op/s 2024-09-17T01:14:44.324 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:44 smithi135 ceph-mon[89112]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 170 B/s wr, 211 op/s 2024-09-17T01:14:44.579 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:44 smithi071 ceph-mon[96259]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 170 B/s wr, 211 op/s 2024-09-17T01:14:44.579 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:44 smithi071 ceph-mon[105664]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 134 KiB/s rd, 170 B/s wr, 211 op/s 2024-09-17T01:14:46.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:46.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:46 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:46.372 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:46 smithi135 ceph-mon[89112]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-09-17T01:14:46.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:46.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:46 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:46.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:46 smithi071 ceph-mon[96259]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-09-17T01:14:46.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:46.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:46 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:46.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:46 smithi071 ceph-mon[105664]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-09-17T01:14:47.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:14:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:14:46] "GET /metrics HTTP/1.1" 200 38656 "" "Prometheus/2.43.0" 2024-09-17T01:14:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: Upgrade: Updating rgw.smpl.smithi135.zqqxdl (4/4) 2024-09-17T01:14:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: Deploying daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: Upgrade: Updating rgw.smpl.smithi135.zqqxdl (4/4) 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: Deploying daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T01:14:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: Upgrade: Updating rgw.smpl.smithi135.zqqxdl (4/4) 2024-09-17T01:14:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.smpl.smithi135.zqqxdl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T01:14:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: Deploying daemon rgw.smpl.smithi135.zqqxdl on smithi135 2024-09-17T01:14:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:47.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:48 smithi135 ceph-mon[89112]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 176 KiB/s rd, 255 B/s wr, 277 op/s 2024-09-17T01:14:48.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.688 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[105664]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 176 KiB/s rd, 255 B/s wr, 277 op/s 2024-09-17T01:14:48.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[96259]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 176 KiB/s rd, 255 B/s wr, 277 op/s 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:48.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:14:50.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:50 smithi135 ceph-mon[89112]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 152 KiB/s rd, 170 B/s wr, 239 op/s 2024-09-17T01:14:50.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:50 smithi071 ceph-mon[105664]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 152 KiB/s rd, 170 B/s wr, 239 op/s 2024-09-17T01:14:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:50 smithi071 ceph-mon[96259]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 152 KiB/s rd, 170 B/s wr, 239 op/s 2024-09-17T01:14:51.617 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:51 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:51.617 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:51 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:51 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:14:52.604 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:52 smithi071 ceph-mon[105664]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-09-17T01:14:52.604 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:52 smithi071 ceph-mon[96259]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-09-17T01:14:52.807 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:52 smithi135 ceph-mon[89112]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 157 KiB/s rd, 170 B/s wr, 248 op/s 2024-09-17T01:14:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 170 B/s wr, 188 op/s 2024-09-17T01:14:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:54.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.648 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi071.hdtkfj"}]: dispatch 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi071.hdtkfj"}]': finished 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi135.zorred"}]: dispatch 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi135.zorred"}]': finished 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi071.dosgxu"}]: dispatch 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi071.dosgxu"}]': finished 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi135.zqqxdl"}]: dispatch 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi135.zqqxdl"}]': finished 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.649 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 170 B/s wr, 188 op/s 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:54.650 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi071.hdtkfj"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi071.hdtkfj"}]': finished 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi135.zorred"}]: dispatch 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi135.zorred"}]': finished 2024-09-17T01:14:54.651 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi071.dosgxu"}]: dispatch 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi071.dosgxu"}]': finished 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi135.zqqxdl"}]: dispatch 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi135.zqqxdl"}]': finished 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.652 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:54 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 170 B/s wr, 188 op/s 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T01:14:54.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi071.hdtkfj"}]: dispatch 2024-09-17T01:14:54.712 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi071.hdtkfj"}]': finished 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi135.zorred"}]: dispatch 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi135.zorred"}]': finished 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi071.dosgxu"}]: dispatch 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi071.dosgxu"}]': finished 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi135.zqqxdl"}]: dispatch 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.smpl.smithi135.zqqxdl"}]': finished 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:14:54.713 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:54 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:55.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:55 smithi135 ceph-mon[89112]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 97 B/s wr, 184 op/s 2024-09-17T01:14:55.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:55 smithi135 ceph-mon[89112]: Upgrade: Setting container_image for all rgw 2024-09-17T01:14:55.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:55 smithi135 ceph-mon[89112]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:14:55.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:55 smithi135 ceph-mon[89112]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:14:55.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:55 smithi135 ceph-mon[89112]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:14:55.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[96259]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 97 B/s wr, 184 op/s 2024-09-17T01:14:55.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[96259]: Upgrade: Setting container_image for all rgw 2024-09-17T01:14:55.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[96259]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:14:55.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[96259]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:14:55.814 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[96259]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:14:55.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[105664]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 279 MiB used, 715 GiB / 715 GiB avail; 117 KiB/s rd, 97 B/s wr, 184 op/s 2024-09-17T01:14:55.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[105664]: Upgrade: Setting container_image for all rgw 2024-09-17T01:14:55.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[105664]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:14:55.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[105664]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:14:55.815 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:55 smithi071 ceph-mon[105664]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T01:14:56.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:56 smithi135 ceph-mon[89112]: Upgrade: Updating iscsi.foo.smithi071.mtaene 2024-09-17T01:14:56.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:56.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:14:56.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:56 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:56.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:56 smithi135 ceph-mon[89112]: Deploying daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:14:56.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[105664]: Upgrade: Updating iscsi.foo.smithi071.mtaene 2024-09-17T01:14:56.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:56.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:14:56.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:56.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[105664]: Deploying daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:14:56.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[96259]: Upgrade: Updating iscsi.foo.smithi071.mtaene 2024-09-17T01:14:56.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:14:56.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi071.mtaene", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-17T01:14:56.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:14:56.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:56 smithi071 ceph-mon[96259]: Deploying daemon iscsi.foo.smithi071.mtaene on smithi071 2024-09-17T01:14:57.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:14:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:14:56] "GET /metrics HTTP/1.1" 200 38685 "" "Prometheus/2.43.0" 2024-09-17T01:14:57.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:57 smithi135 ceph-mon[89112]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 160 KiB/s rd, 97 B/s wr, 253 op/s 2024-09-17T01:14:57.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:57 smithi071 ceph-mon[105664]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 160 KiB/s rd, 97 B/s wr, 253 op/s 2024-09-17T01:14:57.776 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:57 smithi071 ceph-mon[96259]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 160 KiB/s rd, 97 B/s wr, 253 op/s 2024-09-17T01:14:59.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:14:59 smithi135 ceph-mon[89112]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 97 B/s wr, 209 op/s 2024-09-17T01:14:59.849 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:14:59 smithi071 ceph-mon[96259]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 97 B/s wr, 209 op/s 2024-09-17T01:14:59.850 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:14:59 smithi071 ceph-mon[105664]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 97 B/s wr, 209 op/s 2024-09-17T01:15:00.584 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:15:01.238 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 14s ago 22m - - 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 7s ago 22m - - 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (11m) 14s ago 17m 25.6M - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (11m) 7s ago 17m 54.4M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (10m) 14s ago 15m 61.6M - 3.5 e1d6a67b021e a4e479bd2b32 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (10m) 7s ago 21m 531M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (9m) 14s ago 23m 443M - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (8m) 14s ago 23m 78.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (7m) 7s ago 21m 57.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (7m) 14s ago 21m 65.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:15:01.239 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (12m) 14s ago 17m 15.6M - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (11m) 7s ago 17m 16.3M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (6m) 14s ago 21m 60.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (5m) 14s ago 20m 66.0M 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (4m) 14s ago 20m 53.8M 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (3m) 14s ago 20m 57.5M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (3m) 7s ago 19m 64.0M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (2m) 7s ago 19m 58.0M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d0a342ff9876 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (100s) 7s ago 18m 47.0M 4096M 19.1.1-330-gc2ddf972 ebb0615149de aed6d465c455 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (49s) 7s ago 18m 46.4M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 3327a7bed00a 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (10m) 7s ago 17m 66.8M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (28s) 14s ago 15m 76.9M - 19.1.1-330-gc2ddf972 ebb0615149de ee0bdbb09acd 2024-09-17T01:15:01.240 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (16s) 7s ago 15m 35.9M - 19.1.1-330-gc2ddf972 ebb0615149de 452b953ffe4f 2024-09-17T01:15:01.241 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (21s) 14s ago 15m 75.8M - 19.1.1-330-gc2ddf972 ebb0615149de e2f9f2c7b32f 2024-09-17T01:15:01.241 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 unknown 7s ago 15m - - 2024-09-17T01:15:01.638 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:15:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:15:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:15:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:15:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 17 2024-09-17T01:15:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:15:01.640 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:15:01.640 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:01 smithi071 ceph-mon[105664]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s rd, 97 B/s wr, 159 op/s 2024-09-17T01:15:01.640 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:01 smithi071 ceph-mon[105664]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:01.640 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:01 smithi071 ceph-mon[105664]: from='client.64762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:01.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:01 smithi071 ceph-mon[96259]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s rd, 97 B/s wr, 159 op/s 2024-09-17T01:15:01.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:01 smithi071 ceph-mon[96259]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:01.641 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:01 smithi071 ceph-mon[96259]: from='client.64762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:01 smithi135 ceph-mon[89112]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s rd, 97 B/s wr, 159 op/s 2024-09-17T01:15:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:01 smithi135 ceph-mon[89112]: from='client.15585 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:01.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:01 smithi135 ceph-mon[89112]: from='client.64762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: "mon" 2024-09-17T01:15:01.974 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:15:01.975 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "16/23 daemons upgraded", 2024-09-17T01:15:01.975 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Currently upgrading iscsi daemons", 2024-09-17T01:15:01.975 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": false 2024-09-17T01:15:01.975 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:15:02.371 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-09-17T01:15:02.372 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-09-17T01:15:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: daemon rgw.smpl.smithi135.zqqxdl on smithi135 is in unknown state 2024-09-17T01:15:02.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[96259]: from='client.44808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:02.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[96259]: from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:02.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1118046772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:02.647 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/785163428' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:15:02.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[105664]: from='client.44808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:02.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[105664]: from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:02.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1118046772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:02.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:02 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/785163428' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:15:02.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:02 smithi135 ceph-mon[89112]: from='client.44808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:02.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:02 smithi135 ceph-mon[89112]: from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:02.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:02 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1118046772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:02.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:02 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/785163428' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:15:03.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[105664]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 97 B/s wr, 142 op/s 2024-09-17T01:15:03.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[105664]: from='client.64786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:03.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[96259]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 97 B/s wr, 142 op/s 2024-09-17T01:15:03.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[96259]: from='client.64786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:03.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:03.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:03 smithi135 ceph-mon[89112]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 97 B/s wr, 142 op/s 2024-09-17T01:15:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:03 smithi135 ceph-mon[89112]: from='client.64786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:05.777 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:05 smithi071 ceph-mon[96259]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 97 B/s wr, 142 op/s 2024-09-17T01:15:05.778 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:05 smithi071 ceph-mon[105664]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 97 B/s wr, 142 op/s 2024-09-17T01:15:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:05 smithi135 ceph-mon[89112]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s rd, 97 B/s wr, 142 op/s 2024-09-17T01:15:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:15:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:15:06] "GET /metrics HTTP/1.1" 200 38700 "" "Prometheus/2.43.0" 2024-09-17T01:15:07.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[96259]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-17T01:15:07.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[105664]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-17T01:15:07.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:07 smithi135 ceph-mon[89112]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-17T01:15:07.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:07.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:08.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:08 smithi071 ceph-mon[105664]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 91 B/s wr, 30 op/s 2024-09-17T01:15:08.633 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:08 smithi071 ceph-mon[105664]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:08.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:08 smithi071 ceph-mon[96259]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 91 B/s wr, 30 op/s 2024-09-17T01:15:08.633 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:08 smithi071 ceph-mon[96259]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:08.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:08 smithi135 ceph-mon[89112]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 91 B/s wr, 30 op/s 2024-09-17T01:15:08.874 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:08 smithi135 ceph-mon[89112]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:09.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:15:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:15:09.786+0000 7f8262355640 -1 log_channel(cephadm) log [ERR] : Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 647 B/s rd, 0 op/s 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 0 op/s 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.721 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:10.722 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 647 B/s rd, 0 op/s 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 0 op/s 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.724 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 647 B/s rd, 0 op/s 2024-09-17T01:15:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 867 B/s rd, 0 op/s 2024-09-17T01:15:10.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:10.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:11.523 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: Checking dashboard <-> RGW credentials 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.524 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[96259]: Health check failed: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: Checking dashboard <-> RGW credentials 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.525 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:11 smithi071 ceph-mon[105664]: Health check failed: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: Checking dashboard <-> RGW credentials 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 op/s 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.774 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 23 op/s 2024-09-17T01:15:11.775 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:11 smithi135 ceph-mon[89112]: Health check failed: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-09-17T01:15:13.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:13 smithi135 ceph-mon[89112]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 9.9 KiB/s rd, 10 op/s 2024-09-17T01:15:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:13 smithi071 ceph-mon[96259]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 9.9 KiB/s rd, 10 op/s 2024-09-17T01:15:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:13 smithi071 ceph-mon[105664]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 9.9 KiB/s rd, 10 op/s 2024-09-17T01:15:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:15 smithi071 ceph-mon[96259]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 6.1 KiB/s rd, 6 op/s 2024-09-17T01:15:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:15 smithi071 ceph-mon[105664]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 6.1 KiB/s rd, 6 op/s 2024-09-17T01:15:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:15 smithi135 ceph-mon[89112]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 6.1 KiB/s rd, 6 op/s 2024-09-17T01:15:17.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:15:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:15:16] "GET /metrics HTTP/1.1" 200 38700 "" "Prometheus/2.43.0" 2024-09-17T01:15:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:17 smithi071 ceph-mon[96259]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-17T01:15:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:17 smithi071 ceph-mon[105664]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-17T01:15:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:17 smithi135 ceph-mon[89112]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-17T01:15:19.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:19 smithi135 ceph-mon[89112]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-17T01:15:19.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:19.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:19 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:19 smithi071 ceph-mon[96259]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-17T01:15:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:19 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:19 smithi071 ceph-mon[105664]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-17T01:15:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:19.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:19 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:21 smithi135 ceph-mon[89112]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T01:15:21.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:21 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3599943667' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:15:21.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:21 smithi071 ceph-mon[96259]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T01:15:21.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:21 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3599943667' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:15:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:21 smithi071 ceph-mon[105664]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-17T01:15:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:21 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3599943667' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:15:23.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:23 smithi135 ceph-mon[89112]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:23 smithi071 ceph-mon[96259]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:23 smithi071 ceph-mon[105664]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:25.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:25 smithi135 ceph-mon[89112]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:15:25.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:25 smithi071 ceph-mon[96259]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:15:25.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:25 smithi071 ceph-mon[105664]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-09-17T01:15:27.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:15:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:15:26] "GET /metrics HTTP/1.1" 200 38794 "" "Prometheus/2.43.0" 2024-09-17T01:15:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[96259]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s 2024-09-17T01:15:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[96259]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 500 B/s rd, 0 op/s 2024-09-17T01:15:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[96259]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-09-17T01:15:27.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[105664]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s 2024-09-17T01:15:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[105664]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 500 B/s rd, 0 op/s 2024-09-17T01:15:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[105664]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-09-17T01:15:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:27 smithi135 ceph-mon[89112]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s 2024-09-17T01:15:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:27 smithi135 ceph-mon[89112]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 500 B/s rd, 0 op/s 2024-09-17T01:15:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:27 smithi135 ceph-mon[89112]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-09-17T01:15:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:29.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:29 smithi071 ceph-mon[96259]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-09-17T01:15:29.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:29 smithi071 ceph-mon[105664]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-09-17T01:15:29.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:29 smithi135 ceph-mon[89112]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-09-17T01:15:30.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[96259]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 693 B/s rd, 0 op/s 2024-09-17T01:15:30.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[96259]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 1 op/s 2024-09-17T01:15:30.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[105664]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 693 B/s rd, 0 op/s 2024-09-17T01:15:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[105664]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 1 op/s 2024-09-17T01:15:30.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:30.940 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:30 smithi135 ceph-mon[89112]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 693 B/s rd, 0 op/s 2024-09-17T01:15:30.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:30 smithi135 ceph-mon[89112]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 1 op/s 2024-09-17T01:15:30.941 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:31.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:31 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:31.754 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:31 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:31.953 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:31 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:32.749 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:15:33.110 INFO:teuthology.orchestra.run.smithi071.stdout:"Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed." 2024-09-17T01:15:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-09-17T01:15:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 0 op/s 2024-09-17T01:15:33.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:15:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.711 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:33.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-09-17T01:15:33.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 0 op/s 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:15:33.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.898 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-09-17T01:15:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 851 B/s rd, 0 op/s 2024-09-17T01:15:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:15:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:15:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T01:15:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:33.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:34.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T01:15:34.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:34 smithi071 ceph-mon[96259]: from='client.64858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:34.830 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:34 smithi071 ceph-mon[96259]: from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:34.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:34 smithi071 ceph-mon[105664]: from='client.64858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:34.831 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:34 smithi071 ceph-mon[105664]: from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:34.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:34 smithi135 ceph-mon[89112]: from='client.64858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:34.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:34 smithi135 ceph-mon[89112]: from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:35.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:35 smithi071 ceph-mon[96259]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:15:35.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:35 smithi071 ceph-mon[105664]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:15:35.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:35 smithi135 ceph-mon[89112]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-17T01:15:36.628 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 4s ago 22m - - 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 10s ago 22m - - 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (12m) 4s ago 17m - - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (11m) 10s ago 17m 53.3M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (16s) 4s ago 16m - - 3.8 ebb0615149de faabdf6e6e2e 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (11m) 10s ago 22m 532M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (9m) 4s ago 23m - - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (9m) 4s ago 23m - 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (8m) 10s ago 22m 62.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (8m) 4s ago 22m - 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:15:36.629 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (12m) 4s ago 18m - - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (12m) 10s ago 18m 16.4M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (6m) 4s ago 21m - 4096M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (5m) 4s ago 21m - 4096M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (5m) 4s ago 21m - 4096M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (4m) 4s ago 20m - 4096M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (3m) 10s ago 20m 68.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (3m) 10s ago 19m 60.6M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d0a342ff9876 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (2m) 10s ago 19m 49.4M 4096M 19.1.1-330-gc2ddf972 ebb0615149de aed6d465c455 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (84s) 10s ago 19m 49.4M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 3327a7bed00a 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (10m) 10s ago 18m 64.3M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (64s) 4s ago 16m - - 19.1.1-330-gc2ddf972 ebb0615149de ee0bdbb09acd 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (52s) 10s ago 16m 77.4M - 19.1.1-330-gc2ddf972 ebb0615149de 452b953ffe4f 2024-09-17T01:15:36.630 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (57s) 4s ago 16m - - 19.1.1-330-gc2ddf972 ebb0615149de e2f9f2c7b32f 2024-09-17T01:15:36.631 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (43s) 10s ago 16m 76.5M - 19.1.1-330-gc2ddf972 ebb0615149de 0a23c8ad6cd3 2024-09-17T01:15:37.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:15:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:15:36] "GET /metrics HTTP/1.1" 200 38792 "" "Prometheus/2.43.0" 2024-09-17T01:15:37.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T01:15:37.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:37 smithi071 ceph-mon[96259]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:37.832 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:37 smithi071 ceph-mon[96259]: from='client.64870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:37.832 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:37 smithi071 ceph-mon[105664]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:37.832 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:37 smithi071 ceph-mon[105664]: from='client.64870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:37 smithi135 ceph-mon[89112]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:37 smithi135 ceph-mon[89112]: from='client.64870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:15:39.650 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:15:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:15:39.650 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:15:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:15:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:15:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:39.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:15:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:15:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:15:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:15:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:15:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:15:39.652 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 17 2024-09-17T01:15:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:15:39.653 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:15:39.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:39 smithi071 ceph-mon[96259]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:39.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:39 smithi071 ceph-mon[105664]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:39.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:39 smithi135 ceph-mon[89112]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-17T01:15:40.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-17T01:15:40.701 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:40 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3159948548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:40.702 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:40 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3159948548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:40.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:40 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3159948548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:15:41.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:41 smithi071 ceph-mon[105664]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:15:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:41 smithi071 ceph-mon[96259]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:15:41.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:41 smithi135 ceph-mon[89112]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:15:42.142 INFO:teuthology.orchestra.run.smithi071.stdout:wait for servicemap items w/ changing names to refresh 2024-09-17T01:15:42.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:42 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:42.854 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:42 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:42.854 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:42 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:42.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'sleep 60' 2024-09-17T01:15:43.894 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:43 smithi071 ceph-mon[96259]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-09-17T01:15:43.894 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:43 smithi071 ceph-mon[105664]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-09-17T01:15:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:43 smithi135 ceph-mon[89112]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-09-17T01:15:45.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:45 smithi071 ceph-mon[105664]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:45.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:45 smithi071 ceph-mon[96259]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:45 smithi135 ceph-mon[89112]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:46.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:15:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:15:46] "GET /metrics HTTP/1.1" 200 38792 "" "Prometheus/2.43.0" 2024-09-17T01:15:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[96259]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[105664]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:47 smithi135 ceph-mon[89112]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:47.961 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:48.760 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:48.761 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:15:49.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:49 smithi135 ceph-mon[89112]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:49.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[105664]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[96259]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:49.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:49.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:15:51.334 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:51 smithi071 ceph-mon[105664]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:51.334 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:51 smithi071 ceph-mon[96259]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:51.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:51 smithi135 ceph-mon[89112]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:52.146 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:52 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:52.147 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:52 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:52.149 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:52 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:15:53.301 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:53 smithi071 ceph-mon[96259]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:53.301 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:53 smithi071 ceph-mon[105664]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:53.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:53 smithi135 ceph-mon[89112]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:55 smithi071 ceph-mon[96259]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:55.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:55 smithi071 ceph-mon[105664]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:55.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:55 smithi135 ceph-mon[89112]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:57.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:15:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:15:56] "GET /metrics HTTP/1.1" 200 38792 "" "Prometheus/2.43.0" 2024-09-17T01:15:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:57 smithi071 ceph-mon[96259]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:57.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:57 smithi071 ceph-mon[105664]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:57 smithi135 ceph-mon[89112]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:15:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:15:59 smithi071 ceph-mon[96259]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:59.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:15:59 smithi071 ceph-mon[105664]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:15:59.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:15:59 smithi135 ceph-mon[89112]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:01.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:01 smithi071 ceph-mon[96259]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:01.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:01 smithi071 ceph-mon[105664]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:01 smithi135 ceph-mon[89112]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:02.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:02 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:02.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:02 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:02.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:02 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:03.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:03 smithi071 ceph-mon[96259]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:03.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:03 smithi071 ceph-mon[105664]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:03.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:03 smithi135 ceph-mon[89112]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:05.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:05 smithi071 ceph-mon[105664]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:05 smithi071 ceph-mon[96259]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:05 smithi135 ceph-mon[89112]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:07.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:16:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:16:06] "GET /metrics HTTP/1.1" 200 38793 "" "Prometheus/2.43.0" 2024-09-17T01:16:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[96259]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[105664]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:07 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:07 smithi135 ceph-mon[89112]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:07.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:07.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:07 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[96259]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[105664]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:09 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:09 smithi135 ceph-mon[89112]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:09.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:09.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:09 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:11.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:11 smithi071 ceph-mon[96259]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:11.647 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:11 smithi071 ceph-mon[105664]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:11.668 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:11 smithi135 ceph-mon[89112]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:12.739 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:12 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:12.739 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:12 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:12.786 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:12 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:13.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:13 smithi071 ceph-mon[96259]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:13.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:13 smithi071 ceph-mon[105664]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:13.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:13 smithi135 ceph-mon[89112]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:15.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:15 smithi071 ceph-mon[96259]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:15 smithi071 ceph-mon[105664]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:15 smithi135 ceph-mon[89112]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:17.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:16:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:16:16] "GET /metrics HTTP/1.1" 200 38793 "" "Prometheus/2.43.0" 2024-09-17T01:16:17.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:17 smithi071 ceph-mon[96259]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:17.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:17 smithi071 ceph-mon[105664]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:17 smithi135 ceph-mon[89112]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:18.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:18 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:18.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:18 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:18.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:18 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:19.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:19 smithi071 ceph-mon[96259]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:19.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:19 smithi071 ceph-mon[105664]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:19 smithi135 ceph-mon[89112]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:21.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:21 smithi071 ceph-mon[96259]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:21.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:21 smithi071 ceph-mon[105664]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:21.932 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:21 smithi135 ceph-mon[89112]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:22.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:22 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:22.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:22 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:22.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:22 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:23.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:23 smithi071 ceph-mon[96259]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:23.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:23 smithi071 ceph-mon[105664]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:23.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:23 smithi135 ceph-mon[89112]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:25.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:25 smithi071 ceph-mon[96259]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:25.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:25 smithi071 ceph-mon[105664]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:25.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:25 smithi135 ceph-mon[89112]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:27.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:16:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:16:26] "GET /metrics HTTP/1.1" 200 38793 "" "Prometheus/2.43.0" 2024-09-17T01:16:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[96259]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[105664]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:27 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:27 smithi135 ceph-mon[89112]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:27.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:27 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:28.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:28 smithi071 ceph-mon[105664]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:28.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:28 smithi071 ceph-mon[96259]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:28.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:28 smithi135 ceph-mon[89112]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:30.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:30 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:30 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:30.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:30 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:31.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:31 smithi071 ceph-mon[105664]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:31.303 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:31 smithi071 ceph-mon[96259]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:31.330 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:31 smithi135 ceph-mon[89112]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:32.309 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:32 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:32.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:32 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:32.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:32 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.210 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:33.211 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:33 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:33.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:33.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:16:33.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:33.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:16:33.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:16:33.398 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:33 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:34.228 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:34 smithi135 ceph-mon[89112]: Adjusting osd_memory_target on smithi071 to 2480M 2024-09-17T01:16:34.228 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:34 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:34.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:34 smithi071 ceph-mon[96259]: Adjusting osd_memory_target on smithi071 to 2480M 2024-09-17T01:16:34.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:34 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:34.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:34 smithi071 ceph-mon[105664]: Adjusting osd_memory_target on smithi071 to 2480M 2024-09-17T01:16:34.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:34 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:35.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:35 smithi071 ceph-mon[96259]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:35.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:35 smithi071 ceph-mon[105664]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:35.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:35 smithi135 ceph-mon[89112]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:37.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:16:36 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:16:36] "GET /metrics HTTP/1.1" 200 38792 "" "Prometheus/2.43.0" 2024-09-17T01:16:37.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:37 smithi071 ceph-mon[105664]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:37.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:37 smithi071 ceph-mon[96259]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:37.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:37 smithi135 ceph-mon[89112]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:39.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:39 smithi071 ceph-mon[105664]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:39.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:39 smithi071 ceph-mon[96259]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:39.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:39 smithi135 ceph-mon[89112]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:41.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:41 smithi071 ceph-mon[96259]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:41.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:41 smithi071 ceph-mon[105664]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:41.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:41 smithi135 ceph-mon[89112]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:42.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:42 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:42.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:42 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:42.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:42 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:43.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:43 smithi071 ceph-mon[96259]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:43.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:43 smithi071 ceph-mon[105664]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:43.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:43 smithi135 ceph-mon[89112]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:45.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T01:16:45.837 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:45 smithi071 ceph-mon[96259]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:45.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:45 smithi071 ceph-mon[105664]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:45.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:45 smithi135 ceph-mon[89112]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:47.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:16:46 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:16:46] "GET /metrics HTTP/1.1" 200 38792 "" "Prometheus/2.43.0" 2024-09-17T01:16:47.272 INFO:teuthology.orchestra.run.smithi071.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:16:47.272 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi071 smithi071 running 18s ago 24m - - 2024-09-17T01:16:47.272 INFO:teuthology.orchestra.run.smithi071.stdout:agent.smithi135 smithi135 running 0s ago 23m - - 2024-09-17T01:16:47.272 INFO:teuthology.orchestra.run.smithi071.stdout:alertmanager.a smithi071 *:9093,9094 running (13m) 18s ago 19m - - 0.25.0 c8568f914cd2 f51d370b6cd5 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:grafana.a smithi135 *:3000 running (13m) 0s ago 18m 53.5M - 8.3.5 dad864ee21e9 76460c4e7b85 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:iscsi.foo.smithi071.mtaene smithi071 running (87s) 18s ago 17m - - 3.8 ebb0615149de faabdf6e6e2e 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.x smithi135 *:8443,9283,8765 running (12m) 0s ago 23m 533M - 19.1.1-330-gc2ddf972 ebb0615149de 6449f418a604 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:mgr.y smithi071 *:8443,9283,8765 running (10m) 18s ago 24m - - 19.1.1-330-gc2ddf972 ebb0615149de ade93e1db1ad 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a smithi071 running (10m) 18s ago 25m - 2048M 19.1.1-330-gc2ddf972 ebb0615149de 8fbbb2c90957 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b smithi135 running (9m) 0s ago 23m 61.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1919d116b948 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c smithi071 running (9m) 18s ago 23m - 2048M 19.1.1-330-gc2ddf972 ebb0615149de 801a38ec4999 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.a smithi071 *:9100 running (13m) 18s ago 19m - - 1.5.0 0da6a335fe13 ac4883280427 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:node-exporter.b smithi135 *:9100 running (13m) 0s ago 19m 16.2M - 1.5.0 0da6a335fe13 1e7677cc058d 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 smithi071 running (7m) 18s ago 23m - 2480M 19.1.1-330-gc2ddf972 ebb0615149de d64a79e0bede 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 smithi071 running (7m) 18s ago 22m - 2480M 19.1.1-330-gc2ddf972 ebb0615149de cd1cf4e04194 2024-09-17T01:16:47.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 smithi071 running (6m) 18s ago 22m - 2480M 19.1.1-330-gc2ddf972 ebb0615149de dc6f9ff13a89 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 smithi071 running (5m) 18s ago 21m - 2480M 19.1.1-330-gc2ddf972 ebb0615149de 498b754b1a92 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 smithi135 running (4m) 0s ago 21m 69.2M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 89346edb14b4 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 smithi135 running (4m) 0s ago 21m 61.6M 4096M 19.1.1-330-gc2ddf972 ebb0615149de d0a342ff9876 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 smithi135 running (3m) 0s ago 20m 49.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de aed6d465c455 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 smithi135 running (2m) 0s ago 20m 49.9M 4096M 19.1.1-330-gc2ddf972 ebb0615149de 3327a7bed00a 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:prometheus.a smithi135 *:9095 running (12m) 0s ago 19m 67.9M - 2.43.0 a07b618ecd1d 9b787f60f5f1 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi071.hdtkfj smithi071 *:8000 running (2m) 18s ago 17m - - 19.1.1-330-gc2ddf972 ebb0615149de ee0bdbb09acd 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.foo.smithi135.zorred smithi135 *:8000 running (2m) 0s ago 17m 78.3M - 19.1.1-330-gc2ddf972 ebb0615149de 452b953ffe4f 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi071.dosgxu smithi071 *:80 running (2m) 18s ago 17m - - 19.1.1-330-gc2ddf972 ebb0615149de e2f9f2c7b32f 2024-09-17T01:16:47.274 INFO:teuthology.orchestra.run.smithi071.stdout:rgw.smpl.smithi135.zqqxdl smithi135 *:80 running (114s) 0s ago 17m 77.5M - 19.1.1-330-gc2ddf972 ebb0615149de 0a23c8ad6cd3 2024-09-17T01:16:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[105664]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[96259]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:47 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:47 smithi135 ceph-mon[89112]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:47.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:47 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:48.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T01:16:48.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:48 smithi071 ceph-mon[96259]: from='client.64882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:48.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:48 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:48 smithi071 ceph-mon[105664]: from='client.64882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:48.897 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:48 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:48 smithi135 ceph-mon[89112]: from='client.64882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:48.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:48 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:16:49.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[105664]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:49.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.817 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[96259]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:49.817 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.818 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:49 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:49 smithi135 ceph-mon[89112]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:49.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:49 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:16:50.325 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:16:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": { 2024-09-17T01:16:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:16:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:16:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": { 2024-09-17T01:16:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": { 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": { 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "overall": { 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 17 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-17T01:16:50.326 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:16:50.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:50 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/1482992780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:50.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:50 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/1482992780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:50.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:50 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/1482992780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:16:51.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade status' 2024-09-17T01:16:51.877 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:51 smithi071 ceph-mon[105664]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:51.877 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:51 smithi071 ceph-mon[96259]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:51.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:51 smithi135 ceph-mon[89112]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:52.765 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:52 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:52.765 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:52 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:52.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:52 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "in_progress": true, 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "services_complete": [ 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "iscsi", 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr", 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "mon", 2024-09-17T01:16:52.998 INFO:teuthology.orchestra.run.smithi071.stdout: "osd", 2024-09-17T01:16:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw" 2024-09-17T01:16:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-17T01:16:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T01:16:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "message": "Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed.", 2024-09-17T01:16:52.999 INFO:teuthology.orchestra.run.smithi071.stdout: "is_paused": true 2024-09-17T01:16:52.999 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:16:53.737 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:53 smithi071 ceph-mon[96259]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:53.738 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:53 smithi071 ceph-mon[105664]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:53.789 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:53 smithi135 ceph-mon[89112]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:54.439 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph health detail' 2024-09-17T01:16:54.753 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:54 smithi071 ceph-mon[105664]: from='client.44928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:54.753 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:54 smithi071 ceph-mon[96259]: from='client.44928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:54.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:54 smithi135 ceph-mon[89112]: from='client.44928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:16:55.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:55 smithi071 ceph-mon[96259]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:55.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:55 smithi071 ceph-mon[105664]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:55.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:55 smithi135 ceph-mon[89112]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:57.210 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:16:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:16:56] "GET /metrics HTTP/1.1" 200 38788 "" "Prometheus/2.43.0" 2024-09-17T01:16:57.337 INFO:teuthology.orchestra.run.smithi071.stdout:HEALTH_WARN Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:[WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi071.mtaene on host smithi071 failed. 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrade daemon: iscsi.foo.smithi071.mtaene: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi071.mtaene ... 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:Creating ceph-iscsi config... 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/iscsi-gateway.cfg 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:Write file: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/iscsi.foo.smithi071.mtaene/tcmu-runner-entrypoint.sh 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2de9235fcc\x2d748e\x2d11ef\x2dbceb\x2dc7b262605968.slice/ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:Non-zero exit code 1 from systemctl start ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:systemctl: stderr See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout:Traceback (most recent call last): 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout: return _run_code(code, main_globals, None, 2024-09-17T01:16:57.338 INFO:teuthology.orchestra.run.smithi071.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: exec(code, run_globals) 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5579, in 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 5567, in main 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3049, in command_deploy_from 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3084, in _common_deploy 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 3104, in _deploy_daemon_container 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1088, in deploy_daemon 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/__main__.py", line 1224, in deploy_daemon_units 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout: File "/tmp/tmpnroy8d0w.cephadm.build/app/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout:RuntimeError: Failed command: systemctl start ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene: Job for ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service failed because the control process exited with error code. 2024-09-17T01:16:57.339 INFO:teuthology.orchestra.run.smithi071.stdout:See "systemctl status ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" and "journalctl -xeu ceph-e9235fcc-748e-11ef-bceb-c7b262605968@iscsi.foo.smithi071.mtaene.service" for details. 2024-09-17T01:16:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:57 smithi071 ceph-mon[96259]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:57.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:57 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2161342522' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:16:57.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:57 smithi071 ceph-mon[105664]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:57.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:57 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2161342522' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:16:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:57 smithi135 ceph-mon[89112]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:16:57.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:57 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2161342522' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:16:58.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-17T01:16:59.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:16:59 smithi071 ceph-mon[96259]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:59.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:16:59 smithi071 ceph-mon[105664]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:16:59.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:16:59 smithi135 ceph-mon[89112]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:00.209 INFO:teuthology.orchestra.run.smithi071.stdout:true 2024-09-17T01:17:00.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:00 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/2300068729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:00.775 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:00 smithi071 ceph-mon[96259]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:00.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:00 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/2300068729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:00.776 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:00 smithi071 ceph-mon[105664]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:00.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-17T01:17:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:00 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/2300068729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:00.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:00 smithi135 ceph-mon[89112]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:01.824 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:01 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:17:01.825 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:01 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:17:01.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:01 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:17:02.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:02 smithi071 ceph-mon[96259]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:02.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:02 smithi071 ceph-mon[105664]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:02.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:02 smithi135 ceph-mon[89112]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:02.967 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)" 2024-09-17T01:17:03.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-09-17T01:17:03.893 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:03 smithi071 ceph-mon[105664]: from='client.? 172.21.15.71:0/3707638853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:03.893 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:03 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:03.894 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:03 smithi071 ceph-mon[96259]: from='client.? 172.21.15.71:0/3707638853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:03.894 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:03 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:03 smithi135 ceph-mon[89112]: from='client.? 172.21.15.71:0/3707638853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:17:03.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:03 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:17:04.888 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:04 smithi071 ceph-mon[96259]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:04.889 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:04 smithi071 ceph-mon[105664]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:04.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:04 smithi135 ceph-mon[89112]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:05.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd 8 18s ago - 2024-09-17T01:17:05.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:05 smithi071 ceph-mon[96259]: from='client.44952 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:05.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:05 smithi071 ceph-mon[105664]: from='client.44952 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:05.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:05 smithi135 ceph-mon[89112]: from='client.44952 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:06.276 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:17:06.286 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi071.front.sepia.ceph.com 2024-09-17T01:17:06.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch upgrade ls' 2024-09-17T01:17:06.896 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:06 smithi071 ceph-mon[96259]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:06.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:06 smithi071 ceph-mon[105664]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:06.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:06 smithi135 ceph-mon[89112]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:06.960 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:17:06] "GET /metrics HTTP/1.1" 200 38792 "" "Prometheus/2.43.0" 2024-09-17T01:17:08.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:08 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.397 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:08 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:08 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:08.704 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-17T01:17:08.704 INFO:teuthology.orchestra.run.smithi071.stdout: "image": "quay.io/ceph/ceph", 2024-09-17T01:17:08.704 INFO:teuthology.orchestra.run.smithi071.stdout: "registry": "quay.io", 2024-09-17T01:17:08.705 INFO:teuthology.orchestra.run.smithi071.stdout: "bare_image": "ceph/ceph", 2024-09-17T01:17:08.705 INFO:teuthology.orchestra.run.smithi071.stdout: "versions": [ 2024-09-17T01:17:08.705 INFO:teuthology.orchestra.run.smithi071.stdout: "19.1.1", 2024-09-17T01:17:08.705 INFO:teuthology.orchestra.run.smithi071.stdout: "19.1.0" 2024-09-17T01:17:08.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-17T01:17:08.705 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-17T01:17:09.264 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:09 smithi071 ceph-mon[96259]: from='client.64924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:09.265 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:09 smithi071 ceph-mon[96259]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:09.265 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:09 smithi071 ceph-mon[105664]: from='client.64924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:09.265 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:09 smithi071 ceph-mon[105664]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:09.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0' 2024-09-17T01:17:09.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:09 smithi135 ceph-mon[89112]: from='client.64924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:09.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:09 smithi135 ceph-mon[89112]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:10.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:10 smithi071 ceph-mon[96259]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:10 smithi071 ceph-mon[105664]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:10.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:10 smithi135 ceph-mon[89112]: from='mgr.25406 172.21.15.135:0/4071491782' entity='mgr.x' 2024-09-17T01:17:11.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:11 smithi071 ceph-mon[96259]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:11.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:11 smithi071 ceph-mon[105664]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:11.710 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:11 smithi135 ceph-mon[89112]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:17:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "16.2.0", 2024-09-17T01:17:12.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:12 smithi071 ceph-mon[105664]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:17:12.374 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:12 smithi071 ceph-mon[105664]: from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:12.374 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:12 smithi071 ceph-mon[96259]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:17:12.374 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:12 smithi071 ceph-mon[96259]: from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:12.396 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e9235fcc-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2' 2024-09-17T01:17:12.554 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:12 smithi135 ceph-mon[89112]: from='client.64843 -' entity='client.iscsi.foo.smithi071.mtaene' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-17T01:17:12.554 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:12 smithi135 ceph-mon[89112]: from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:13.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:13 smithi135 ceph-mon[89112]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:13.646 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:13 smithi071 ceph-mon[96259]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:13.646 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:13 smithi071 ceph-mon[105664]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:14.803 INFO:teuthology.orchestra.run.smithi071.stdout: "v16.2.2", 2024-09-17T01:17:14.804 INFO:teuthology.orchestra.run.smithi071.stdout: "v16.2.2-20210505", 2024-09-17T01:17:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:15 smithi071 ceph-mon[105664]: from='client.64936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:15.896 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:15 smithi071 ceph-mon[105664]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:15 smithi071 ceph-mon[96259]: from='client.64936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:15.897 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:15 smithi071 ceph-mon[96259]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:15 smithi135 ceph-mon[89112]: from='client.64936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:17:15.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:15 smithi135 ceph-mon[89112]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 283 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-17T01:17:15.984 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T01:17:15.993 INFO:tasks.cephadm:Teardown begin 2024-09-17T01:17:15.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:17:16.022 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:17:16.057 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T01:17:16.058 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:17:16.076 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:17:16.114 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T01:17:16.114 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-17T01:17:16.114 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a 2024-09-17T01:17:16.288 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:16 smithi071 systemd[1]: Stopping Ceph mon.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:16.773 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:17:16] ENGINE Bus STOPPING 2024-09-17T01:17:16.773 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: ::ffff:172.21.15.135 - - [17/Sep/2024:01:17:16] "GET /metrics HTTP/1.1" 200 38792 "" "Prometheus/2.43.0" 2024-09-17T01:17:17.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[96255]: 2024-09-17T01:17:16.695+0000 7f09b58a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:17.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:16 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a[96255]: 2024-09-17T01:17:16.695+0000 7f09b58a7640 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-09-17T01:17:17.044 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:16 smithi071 podman[178398]: 2024-09-17 01:17:16.757953139 +0000 UTC m=+0.166089283 container died 8fbbb2c9095775fe4a50112c5950961fd3d8b415c13dff75579924605fcb7a6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T01:17:17.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:17:16] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T01:17:17.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:17:16] ENGINE Bus STOPPED 2024-09-17T01:17:17.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:17:16] ENGINE Bus STARTING 2024-09-17T01:17:17.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:17:16] ENGINE Serving on http://:::9283 2024-09-17T01:17:17.208 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: [17/Sep/2024:01:17:16] ENGINE Bus STARTED 2024-09-17T01:17:17.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:17 smithi071 podman[178398]: 2024-09-17 01:17:17.137701579 +0000 UTC m=+0.545837720 container cleanup 8fbbb2c9095775fe4a50112c5950961fd3d8b415c13dff75579924605fcb7a6a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:17:17.396 INFO:journalctl@ceph.mon.a.smithi071.stdout:Sep 17 01:17:17 smithi071 bash[178398]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-a 2024-09-17T01:17:18.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.a.service' 2024-09-17T01:17:18.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:18.171 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-17T01:17:18.172 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-17T01:17:18.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.c 2024-09-17T01:17:18.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:18 smithi071 systemd[1]: Stopping Ceph mon.c for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:18.786 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c[105660]: 2024-09-17T01:17:18.487+0000 7fed53ecc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:18.786 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:18 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c[105660]: 2024-09-17T01:17:18.487+0000 7fed53ecc640 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-09-17T01:17:18.786 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:18 smithi071 podman[178566]: 2024-09-17 01:17:18.518303189 +0000 UTC m=+0.157140153 container died 801a38ec49997a6a0fc566c3c3e51c70f4d392073e9ebc0431dca1aa920cceed (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T01:17:19.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:18 smithi071 podman[178566]: 2024-09-17 01:17:18.87874055 +0000 UTC m=+0.517577505 container cleanup 801a38ec49997a6a0fc566c3c3e51c70f4d392073e9ebc0431dca1aa920cceed (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux ) 2024-09-17T01:17:19.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 17 01:17:18 smithi071 bash[178566]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-c 2024-09-17T01:17:19.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.c.service' 2024-09-17T01:17:19.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:19.348 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-17T01:17:19.348 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-17T01:17:19.348 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.b 2024-09-17T01:17:19.683 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:19 smithi135 systemd[1]: Stopping Ceph mon.b for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b[89108]: 2024-09-17T01:17:19.684+0000 7f9fbbca3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b[89108]: 2024-09-17T01:17:19.684+0000 7f9fbbca3640 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-09-17T01:17:19.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:19 smithi135 podman[151259]: 2024-09-17 01:17:19.716000452 +0000 UTC m=+0.167834678 container died 1919d116b948ed243a723ee3f02a8d1c323808b43c39a621b8a2584874d34d2c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T01:17:20.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:20 smithi135 podman[151259]: 2024-09-17 01:17:20.193895239 +0000 UTC m=+0.645729503 container cleanup 1919d116b948ed243a723ee3f02a8d1c323808b43c39a621b8a2584874d34d2c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T01:17:20.460 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 17 01:17:20 smithi135 bash[151259]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mon-b 2024-09-17T01:17:20.614 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mon.b.service' 2024-09-17T01:17:20.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:20.682 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-17T01:17:20.683 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-17T01:17:20.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y 2024-09-17T01:17:21.019 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:17:20 smithi071 systemd[1]: Stopping Ceph mgr.y for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:21.297 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:17:21 smithi071 podman[178687]: 2024-09-17 01:17:21.022139187 +0000 UTC m=+0.148385470 container died ade93e1db1ada5f8666d09c32ec568f465f1d868e5bed15418796fba50267aa3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:17:21.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:17:21 smithi071 podman[178687]: 2024-09-17 01:17:21.407781639 +0000 UTC m=+0.534027915 container cleanup ade93e1db1ada5f8666d09c32ec568f465f1d868e5bed15418796fba50267aa3 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:17:21.646 INFO:journalctl@ceph.mgr.y.smithi071.stdout:Sep 17 01:17:21 smithi071 bash[178687]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-y 2024-09-17T01:17:21.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-17T01:17:21.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:21.815 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-17T01:17:21.815 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-17T01:17:21.815 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x 2024-09-17T01:17:22.105 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:21 smithi135 systemd[1]: Stopping Ceph mgr.x for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:22.430 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x[58810]: 2024-09-17T01:17:22.106+0000 7f82cd689640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:22.430 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:22 smithi135 podman[151380]: 2024-09-17 01:17:22.138317479 +0000 UTC m=+0.131791445 container died 6449f418a604cc0cd1044ff2fe369a7d7b56ff6780fc3bb8bdaf0ad109578755 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T01:17:22.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:22 smithi135 podman[151380]: 2024-09-17 01:17:22.649329315 +0000 UTC m=+0.642803280 container cleanup 6449f418a604cc0cd1044ff2fe369a7d7b56ff6780fc3bb8bdaf0ad109578755 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:17:22.710 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:22 smithi135 bash[151380]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x 2024-09-17T01:17:23.242 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Sep 17 01:17:22 smithi135 podman[151393]: 2024-09-17 01:17:22.984375031 +0000 UTC m=+0.840404041 container remove 6449f418a604cc0cd1044ff2fe369a7d7b56ff6780fc3bb8bdaf0ad109578755 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:17:23.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-17T01:17:23.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:23.291 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-17T01:17:23.291 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T01:17:23.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0 2024-09-17T01:17:23.592 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:23 smithi071 systemd[1]: Stopping Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:23.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[118414]: 2024-09-17T01:17:23.594+0000 7f265a659640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:23.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[118414]: 2024-09-17T01:17:23.594+0000 7f265a659640 -1 osd.0 187 *** Got signal Terminated *** 2024-09-17T01:17:23.896 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:23 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0[118414]: 2024-09-17T01:17:23.594+0000 7f265a659640 -1 osd.0 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:17:29.396 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:29 smithi071 podman[178810]: 2024-09-17 01:17:29.14296756 +0000 UTC m=+5.659169325 container died d64a79e0beded5d8013107f0aeeab92600b43eec83cb84aac5bacf9b5086437c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:17:29.878 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:29 smithi071 podman[178810]: 2024-09-17 01:17:29.671485213 +0000 UTC m=+6.187686977 container cleanup d64a79e0beded5d8013107f0aeeab92600b43eec83cb84aac5bacf9b5086437c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:17:29.879 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:29 smithi071 bash[178810]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:17:30.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:29 smithi071 podman[179339]: 2024-09-17 01:17:29.881643745 +0000 UTC m=+0.789514785 container remove d64a79e0beded5d8013107f0aeeab92600b43eec83cb84aac5bacf9b5086437c (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97) 2024-09-17T01:17:31.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:31 smithi071 podman[179564]: 2024-09-17 01:17:30.946066692 +0000 UTC m=+0.015547656 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:17:31.146 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:31 smithi071 podman[179564]: 2024-09-17 01:17:31.052415858 +0000 UTC m=+0.121896856 container create 4e2cf4402b429b5b364a4f87dd6a2e157355364be4044a0505ea73caf75d2675 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:17:31.493 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:31 smithi071 podman[179564]: 2024-09-17 01:17:31.305069254 +0000 UTC m=+0.374550211 container init 4e2cf4402b429b5b364a4f87dd6a2e157355364be4044a0505ea73caf75d2675 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:17:31.493 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:31 smithi071 podman[179564]: 2024-09-17 01:17:31.308642723 +0000 UTC m=+0.378123679 container start 4e2cf4402b429b5b364a4f87dd6a2e157355364be4044a0505ea73caf75d2675 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:17:31.493 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:31 smithi071 podman[179564]: 2024-09-17 01:17:31.404711377 +0000 UTC m=+0.474192333 container attach 4e2cf4402b429b5b364a4f87dd6a2e157355364be4044a0505ea73caf75d2675 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-17T01:17:32.041 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:31 smithi071 podman[179564]: 2024-09-17 01:17:31.496099785 +0000 UTC m=+0.565580749 container died 4e2cf4402b429b5b364a4f87dd6a2e157355364be4044a0505ea73caf75d2675 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:17:32.041 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:32 smithi071 podman[179588]: 2024-09-17 01:17:32.027250404 +0000 UTC m=+0.525178813 container remove 4e2cf4402b429b5b364a4f87dd6a2e157355364be4044a0505ea73caf75d2675 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T01:17:32.041 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:32 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T01:17:32.041 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:32 smithi071 systemd[1]: Stopped Ceph osd.0 for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:17:32.041 INFO:journalctl@ceph.osd.0.smithi071.stdout:Sep 17 01:17:32 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service: Consumed 7.581s CPU time. 2024-09-17T01:17:32.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T01:17:32.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:32.082 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T01:17:32.082 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T01:17:32.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.1 2024-09-17T01:17:32.396 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:32 smithi071 systemd[1]: Stopping Ceph osd.1 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:32.896 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[129716]: 2024-09-17T01:17:32.431+0000 7f5720428640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:32.896 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[129716]: 2024-09-17T01:17:32.431+0000 7f5720428640 -1 osd.1 187 *** Got signal Terminated *** 2024-09-17T01:17:32.896 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:32 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1[129716]: 2024-09-17T01:17:32.431+0000 7f5720428640 -1 osd.1 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:17:38.210 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:37 smithi071 podman[179669]: 2024-09-17 01:17:37.954072522 +0000 UTC m=+5.635655205 container died cd1cf4e04194924b47c88aa9a426d7a195a297caf8242c77181597f2b90d18eb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T01:17:38.624 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:38 smithi071 podman[179669]: 2024-09-17 01:17:38.309459833 +0000 UTC m=+5.991042557 container cleanup cd1cf4e04194924b47c88aa9a426d7a195a297caf8242c77181597f2b90d18eb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T01:17:38.625 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:38 smithi071 bash[179669]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:17:38.896 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:38 smithi071 podman[179795]: 2024-09-17 01:17:38.627460558 +0000 UTC m=+0.672951288 container remove cd1cf4e04194924b47c88aa9a426d7a195a297caf8242c77181597f2b90d18eb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-17T01:17:39.287 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:38 smithi071 podman[179882]: 2024-09-17 01:17:38.880373367 +0000 UTC m=+0.015748985 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:17:39.287 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:39 smithi071 podman[179882]: 2024-09-17 01:17:39.011856615 +0000 UTC m=+0.147232282 container create 0c88ba3bb13a6c1200c23ffc1ce125979c52a80676e1701a73200d0f07ad045e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:17:39.287 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:39 smithi071 podman[179882]: 2024-09-17 01:17:39.289766961 +0000 UTC m=+0.425142575 container init 0c88ba3bb13a6c1200c23ffc1ce125979c52a80676e1701a73200d0f07ad045e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T01:17:39.646 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:39 smithi071 podman[179882]: 2024-09-17 01:17:39.293425866 +0000 UTC m=+0.428801474 container start 0c88ba3bb13a6c1200c23ffc1ce125979c52a80676e1701a73200d0f07ad045e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T01:17:39.646 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:39 smithi071 podman[179882]: 2024-09-17 01:17:39.389288225 +0000 UTC m=+0.524663848 container attach 0c88ba3bb13a6c1200c23ffc1ce125979c52a80676e1701a73200d0f07ad045e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-17T01:17:39.646 INFO:journalctl@ceph.osd.1.smithi071.stdout:Sep 17 01:17:39 smithi071 podman[179882]: 2024-09-17 01:17:39.481784513 +0000 UTC m=+0.617160124 container died 0c88ba3bb13a6c1200c23ffc1ce125979c52a80676e1701a73200d0f07ad045e (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T01:17:40.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T01:17:40.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:40.094 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T01:17:40.094 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T01:17:40.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.2 2024-09-17T01:17:40.397 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:40 smithi071 systemd[1]: Stopping Ceph osd.2 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:40.896 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:40 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[135653]: 2024-09-17T01:17:40.437+0000 7f3f16081640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:40.896 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:40 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[135653]: 2024-09-17T01:17:40.437+0000 7f3f16081640 -1 osd.2 187 *** Got signal Terminated *** 2024-09-17T01:17:40.896 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:40 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2[135653]: 2024-09-17T01:17:40.437+0000 7f3f16081640 -1 osd.2 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:17:41.711 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:17:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:17:41.387Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.135:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.135:8765: connect: connection refused" 2024-09-17T01:17:41.711 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:17:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:17:41.387Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.135:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.135:8765: connect: connection refused" 2024-09-17T01:17:41.711 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:17:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:17:41.389Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.135:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.135:8765: connect: connection refused" 2024-09-17T01:17:41.711 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:17:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:17:41.389Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.135:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.135:8765: connect: connection refused" 2024-09-17T01:17:41.712 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:17:41 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:17:41.389Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.135:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.135:8765: connect: connection refused" 2024-09-17T01:17:46.110 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:45 smithi071 podman[179983]: 2024-09-17 01:17:45.814946578 +0000 UTC m=+5.485425026 container died dc6f9ff13a890438c0d698192df394590fb7b4a59988f2b9d6252e490777f2cd (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T01:17:46.396 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:46 smithi071 podman[179983]: 2024-09-17 01:17:46.21145532 +0000 UTC m=+5.881933766 container cleanup dc6f9ff13a890438c0d698192df394590fb7b4a59988f2b9d6252e490777f2cd (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:17:46.396 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:46 smithi071 bash[179983]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:17:46.780 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:46 smithi071 podman[179998]: 2024-09-17 01:17:46.454392203 +0000 UTC m=+0.633171423 container remove dc6f9ff13a890438c0d698192df394590fb7b4a59988f2b9d6252e490777f2cd (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T01:17:47.105 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:46 smithi071 podman[180088]: 2024-09-17 01:17:46.686252618 +0000 UTC m=+0.016249279 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:17:47.105 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:46 smithi071 podman[180088]: 2024-09-17 01:17:46.79724214 +0000 UTC m=+0.127238790 container create ea2cca4122f7dae424611d387493e939614534020ef864bf6514c2e58dc75d60 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T01:17:47.105 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:47 smithi071 podman[180088]: 2024-09-17 01:17:47.024567372 +0000 UTC m=+0.354564029 container init ea2cca4122f7dae424611d387493e939614534020ef864bf6514c2e58dc75d60 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97) 2024-09-17T01:17:47.106 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:47 smithi071 podman[180088]: 2024-09-17 01:17:47.02808975 +0000 UTC m=+0.358086401 container start ea2cca4122f7dae424611d387493e939614534020ef864bf6514c2e58dc75d60 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T01:17:47.396 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:47 smithi071 podman[180088]: 2024-09-17 01:17:47.10785209 +0000 UTC m=+0.437848744 container attach ea2cca4122f7dae424611d387493e939614534020ef864bf6514c2e58dc75d60 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:17:47.396 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 17 01:17:47 smithi071 podman[180088]: 2024-09-17 01:17:47.218241025 +0000 UTC m=+0.548237687 container died ea2cca4122f7dae424611d387493e939614534020ef864bf6514c2e58dc75d60 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:17:47.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T01:17:47.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:47.931 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T01:17:47.931 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T01:17:47.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.3 2024-09-17T01:17:48.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:48 smithi071 systemd[1]: Stopping Ceph osd.3 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:48.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[146411]: 2024-09-17T01:17:48.264+0000 7f6eee989640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:48.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[146411]: 2024-09-17T01:17:48.264+0000 7f6eee989640 -1 osd.3 187 *** Got signal Terminated *** 2024-09-17T01:17:48.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:48 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[146411]: 2024-09-17T01:17:48.264+0000 7f6eee989640 -1 osd.3 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:17:51.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:50 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:50.730+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:52.210 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:51 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:51.734+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:52.646 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:52 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3[146411]: 2024-09-17T01:17:52.301+0000 7f6eeaf9f640 -1 osd.3 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.767749+0000 front 2024-09-17T01:17:26.767767+0000 (oldest deadline 2024-09-17T01:17:51.467940+0000) 2024-09-17T01:17:52.710 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:52.321+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:53.045 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:52.740+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:53.045 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:52 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:52.745+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:53.698 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:53.300+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:53.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:53.729+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:53.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:53 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:53.699+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:54.038 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:53 smithi071 podman[180190]: 2024-09-17 01:17:53.767098516 +0000 UTC m=+5.602859354 container died 498b754b1a921469dd29676d6c8a9e4cfe80e76974f5f9596ab7907df8b10794 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T01:17:54.305 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:54 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:54.048+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:17:54.396 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:54 smithi071 podman[180190]: 2024-09-17 01:17:54.231697319 +0000 UTC m=+6.067458152 container cleanup 498b754b1a921469dd29676d6c8a9e4cfe80e76974f5f9596ab7907df8b10794 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T01:17:54.396 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:54 smithi071 bash[180190]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:17:54.675 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:54 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:54.306+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:54.783 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:54 smithi071 podman[180822]: 2024-09-17 01:17:54.499684589 +0000 UTC m=+0.730194337 container remove 498b754b1a921469dd29676d6c8a9e4cfe80e76974f5f9596ab7907df8b10794 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:17:54.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:54 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:54.733+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:54.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:54 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:54.676+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:55.349 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:55.006+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:17:55.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:55.351+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:55.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:55.685+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:55.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:55.653+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:56.261 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:55 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:55.980+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:17:56.604 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:56.364+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:56.836 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:56 smithi071 podman[181048]: 2024-09-17 01:17:56.492690753 +0000 UTC m=+0.017369812 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:17:56.836 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:56 smithi071 podman[181048]: 2024-09-17 01:17:56.603522093 +0000 UTC m=+0.128201160 container create 28235a9f204ce831ba541f893822af87ff380dfa07c7f0e9eb568f16a037b9e6 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-17T01:17:56.837 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:56 smithi071 podman[181048]: 2024-09-17 01:17:56.83926123 +0000 UTC m=+0.363940289 container init 28235a9f204ce831ba541f893822af87ff380dfa07c7f0e9eb568f16a037b9e6 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-17T01:17:56.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:56.606+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:56.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:56 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:56.697+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:57.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:56 smithi071 podman[181048]: 2024-09-17 01:17:56.842492555 +0000 UTC m=+0.367171618 container start 28235a9f204ce831ba541f893822af87ff380dfa07c7f0e9eb568f16a037b9e6 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-17T01:17:57.146 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:56 smithi071 podman[181048]: 2024-09-17 01:17:56.93945791 +0000 UTC m=+0.464136970 container attach 28235a9f204ce831ba541f893822af87ff380dfa07c7f0e9eb568f16a037b9e6 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T01:17:57.345 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:57 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:57.003+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:17:57.396 INFO:journalctl@ceph.osd.3.smithi071.stdout:Sep 17 01:17:57 smithi071 podman[181048]: 2024-09-17 01:17:57.148781219 +0000 UTC m=+0.673460281 container died 28235a9f204ce831ba541f893822af87ff380dfa07c7f0e9eb568f16a037b9e6 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:17:57.650 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:57 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:57.570+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:57.651 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:57 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:57.344+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:57.651 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:57 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:57.652+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:57.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T01:17:57.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:17:57.993 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T01:17:57.993 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T01:17:57.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.4 2024-09-17T01:17:58.314 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:58 smithi135 systemd[1]: Stopping Ceph osd.4 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:17:58.315 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:58.037+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:17:58.575 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:58.316+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:58.576 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:58.319+0000 7fed38e9c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:17:58.576 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:58.319+0000 7fed38e9c640 -1 osd.4 187 *** Got signal Terminated *** 2024-09-17T01:17:58.576 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:58.319+0000 7fed38e9c640 -1 osd.4 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:17:58.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:58.642+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:58.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:58 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:58.578+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:59.285 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:59.030+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:17:59.544 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:17:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:17:59.287+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:17:59.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:17:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:17:59.622+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:17:59.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:59.546+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:17:59.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:17:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:17:59.546+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:00.290 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:59.990+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:00.291 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:17:59 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:17:59.990+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:00.660 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:00.292+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:00.660 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:00.542+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:00.660 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:00.542+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:00.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:18:00.662+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:18:00.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:00 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:18:00.662+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.191173+0000 front 2024-09-17T01:17:35.191100+0000 (oldest deadline 2024-09-17T01:17:59.891049+0000) 2024-09-17T01:18:01.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:01.037+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:01.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:01.037+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:01.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:01.268+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:01.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:01.268+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:01.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:18:01.624+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:18:01.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:18:01.624+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.191173+0000 front 2024-09-17T01:17:35.191100+0000 (oldest deadline 2024-09-17T01:17:59.891049+0000) 2024-09-17T01:18:01.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:01.516+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:01.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:01 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:01.516+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:02.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:02.072+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:02.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:02.072+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:02.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:02.233+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:02.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:02.233+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:02.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:02.509+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:02.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:02.509+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:02.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:18:02.606+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:26.489985+0000 front 2024-09-17T01:17:26.490009+0000 (oldest deadline 2024-09-17T01:17:51.789973+0000) 2024-09-17T01:18:02.960 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:02 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4[113774]: 2024-09-17T01:18:02.606+0000 7fed314aa640 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.191173+0000 front 2024-09-17T01:17:35.191100+0000 (oldest deadline 2024-09-17T01:17:59.891049+0000) 2024-09-17T01:18:03.459 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:03.186+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:03.459 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:03.186+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:03.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:03.024+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:03.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:03.024+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:03.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:03.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:03.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:03 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:03.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:04.127 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:03 smithi135 podman[152443]: 2024-09-17 01:18:03.839133347 +0000 UTC m=+5.647857804 container died 89346edb14b45a90a80adc03e90c569fc12beb09dc3030c9e8d7da2247827f7a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-17T01:18:04.127 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:04.010+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:04.127 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:04.010+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:04.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:04 smithi135 podman[152443]: 2024-09-17 01:18:04.294541028 +0000 UTC m=+6.103265474 container cleanup 89346edb14b45a90a80adc03e90c569fc12beb09dc3030c9e8d7da2247827f7a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:18:04.460 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:04 smithi135 bash[152443]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:18:04.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:04.194+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:04.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:04.194+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:04.956 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:04 smithi135 podman[152458]: 2024-09-17 01:18:04.604524606 +0000 UTC m=+0.761227667 container remove 89346edb14b45a90a80adc03e90c569fc12beb09dc3030c9e8d7da2247827f7a (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-17T01:18:04.956 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:04.500+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:04.956 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:04.500+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:05.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:05.148+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:05.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:05.148+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:05.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:04.960+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:05.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:04 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:04.960+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:05.211 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:04 smithi135 podman[152548]: 2024-09-17 01:18:04.861640347 +0000 UTC m=+0.016315714 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:18:05.211 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:04 smithi135 podman[152548]: 2024-09-17 01:18:04.980406799 +0000 UTC m=+0.135082155 container create e1a0e13856426258f9b3bfbe88898b55c1a8498936ea01484d7f4eefef4c9354 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-17T01:18:05.211 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:05 smithi135 podman[152548]: 2024-09-17 01:18:05.183802274 +0000 UTC m=+0.338477642 container init e1a0e13856426258f9b3bfbe88898b55c1a8498936ea01484d7f4eefef4c9354 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-17T01:18:05.211 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:05 smithi135 podman[152548]: 2024-09-17 01:18:05.187260428 +0000 UTC m=+0.341935776 container start e1a0e13856426258f9b3bfbe88898b55c1a8498936ea01484d7f4eefef4c9354 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:18:05.508 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:05.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:05.508 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:05.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:05.508 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:05 smithi135 podman[152548]: 2024-09-17 01:18:05.274873633 +0000 UTC m=+0.429548992 container attach e1a0e13856426258f9b3bfbe88898b55c1a8498936ea01484d7f4eefef4c9354 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:18:05.508 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 17 01:18:05 smithi135 podman[152548]: 2024-09-17 01:18:05.388784931 +0000 UTC m=+0.543460298 container died e1a0e13856426258f9b3bfbe88898b55c1a8498936ea01484d7f4eefef4c9354 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:18:06.137 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T01:18:06.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:18:06.180 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T01:18:06.180 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T01:18:06.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.5 2024-09-17T01:18:06.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:06.155+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:06.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:06.155+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:06.211 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:05.943+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:06.211 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:05 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:05.943+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:06.538 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:06 smithi135 systemd[1]: Stopping Ceph osd.5 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:18:06.538 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:06.453+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:06.539 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:06.453+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:06.932 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:06.539+0000 7f6d5819a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:18:06.932 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:06.539+0000 7f6d5819a640 -1 osd.5 187 *** Got signal Terminated *** 2024-09-17T01:18:06.932 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:06.539+0000 7f6d5819a640 -1 osd.5 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:18:07.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:07.126+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:07.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:07.126+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:07.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:06.934+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:07.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:06 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:06.934+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:07.703 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:07.462+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:07.703 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:07.462+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:07.703 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:07.462+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:07.962 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:07.917+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:07.962 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:07 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:07.917+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:08.407 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:08.133+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:08.407 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:08.133+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:08.407 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:08.133+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:43.711913+0000 front 2024-09-17T01:17:43.711932+0000 (oldest deadline 2024-09-17T01:18:07.811889+0000) 2024-09-17T01:18:08.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:08.483+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:08.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:08.483+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:08.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:08.483+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:09.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:09.091+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:09.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:09.091+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:09.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:09.091+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:43.711913+0000 front 2024-09-17T01:17:43.711932+0000 (oldest deadline 2024-09-17T01:18:07.811889+0000) 2024-09-17T01:18:09.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:08.891+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:09.211 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:08.891+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:09.211 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:08 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:08.891+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:09.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:09.514+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:09.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:09.514+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:09.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:09.514+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:10.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:10.077+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:10.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:10.077+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:10.210 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:10.077+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:43.711913+0000 front 2024-09-17T01:17:43.711932+0000 (oldest deadline 2024-09-17T01:18:07.811889+0000) 2024-09-17T01:18:10.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:09.933+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:10.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:09.933+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:10.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:09 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:09.933+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:10.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:10.514+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:10.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:10.514+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:10.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:10.514+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:11.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:11.052+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.409904+0000 front 2024-09-17T01:17:27.409780+0000 (oldest deadline 2024-09-17T01:17:52.109840+0000) 2024-09-17T01:18:11.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:11.052+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:37.410858+0000 front 2024-09-17T01:17:37.410757+0000 (oldest deadline 2024-09-17T01:18:00.910722+0000) 2024-09-17T01:18:11.460 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5[118341]: 2024-09-17T01:18:11.052+0000 7f6d507a8640 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:43.711913+0000 front 2024-09-17T01:17:43.711932+0000 (oldest deadline 2024-09-17T01:18:07.811889+0000) 2024-09-17T01:18:11.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:10.982+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:11.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:10.982+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:11.460 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:10 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:10.982+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:11.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:11.546+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:11.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:11.546+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:11.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:11 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:11.546+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:12.269 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:11 smithi135 podman[152811]: 2024-09-17 01:18:11.989783711 +0000 UTC m=+5.559500843 container died d0a342ff987682cc57b5e6a004563f7c3621c84460fb10d1175d4c79096229df (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:18:12.269 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:12.002+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:12.269 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:12.002+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:12.269 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:12.002+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:12.710 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:12 smithi135 podman[152811]: 2024-09-17 01:18:12.445201183 +0000 UTC m=+6.014918314 container cleanup d0a342ff987682cc57b5e6a004563f7c3621c84460fb10d1175d4c79096229df (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T01:18:12.710 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:12 smithi135 bash[152811]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:18:12.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:12.508+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:12.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:12.508+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:12.711 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:12.508+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:13.071 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:12 smithi135 podman[153324]: 2024-09-17 01:18:12.738303625 +0000 UTC m=+0.741859371 container remove d0a342ff987682cc57b5e6a004563f7c3621c84460fb10d1175d4c79096229df (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-17T01:18:13.072 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:12.956+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:13.072 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:12.956+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:13.072 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:12 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:12.956+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:13.858 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:13.484+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:13.859 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:13.484+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:13.859 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:13.484+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:14.170 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:13.922+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:14.171 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:13.922+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:14.171 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:13 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:13.922+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:14.877 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:14 smithi135 podman[153473]: 2024-09-17 01:18:14.452803227 +0000 UTC m=+0.018068954 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:18:14.877 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:14 smithi135 podman[153473]: 2024-09-17 01:18:14.565560845 +0000 UTC m=+0.130826562 container create 0bd2826a674826c121dee85efaed1fa2c654645878a75d2af73c34edb05c8432 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97) 2024-09-17T01:18:14.877 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:14.528+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:14.877 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:14.528+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:14.877 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:14.528+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:15.133 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:14.878+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:15.134 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:14.878+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:15.134 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:14 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:14.878+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:15.134 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:14 smithi135 podman[153473]: 2024-09-17 01:18:14.922960006 +0000 UTC m=+0.488225730 container init 0bd2826a674826c121dee85efaed1fa2c654645878a75d2af73c34edb05c8432 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97) 2024-09-17T01:18:15.134 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:14 smithi135 podman[153473]: 2024-09-17 01:18:14.926403727 +0000 UTC m=+0.491669449 container start 0bd2826a674826c121dee85efaed1fa2c654645878a75d2af73c34edb05c8432 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:18:15.134 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:14 smithi135 podman[153473]: 2024-09-17 01:18:14.984704073 +0000 UTC m=+0.549969800 container attach 0bd2826a674826c121dee85efaed1fa2c654645878a75d2af73c34edb05c8432 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:18:15.858 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 17 01:18:15 smithi135 podman[153473]: 2024-09-17 01:18:15.767298491 +0000 UTC m=+1.332564208 container died 0bd2826a674826c121dee85efaed1fa2c654645878a75d2af73c34edb05c8432 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:18:15.859 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:15.551+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:15.859 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:15.551+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:15.859 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:15.551+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:15.859 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:15.551+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:16.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:15.860+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:16.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:15.860+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:16.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:15 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:15.860+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:16.262 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T01:18:16.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:18:16.307 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T01:18:16.307 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-17T01:18:16.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.6 2024-09-17T01:18:16.517 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:16 smithi135 systemd[1]: Stopping Ceph osd.6 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:18:16.871 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:16.660+0000 7efdd146c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:18:16.871 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:16.660+0000 7efdd146c640 -1 osd.6 187 *** Got signal Terminated *** 2024-09-17T01:18:16.871 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:16.660+0000 7efdd146c640 -1 osd.6 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:18:16.872 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:16.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:16.872 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:16.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:16.872 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:16.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:16.872 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:16.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:17.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:16.873+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:17.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:16.873+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:17.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:16 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:16.873+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:17.751 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:17.476+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:17.751 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:17.476+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:17.751 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:17.476+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:17.752 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:17.476+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:18.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:17.824+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:18.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:17.824+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:18.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:17 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:17.824+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:18.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:18.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:18.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:18.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:18.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:18.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:18.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:18.461+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:18.812+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:18.812+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:18.812+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:19.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:18 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:18.812+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:52.969161+0000 front 2024-09-17T01:17:52.969076+0000 (oldest deadline 2024-09-17T01:18:18.269092+0000) 2024-09-17T01:18:19.782 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:19.507+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:19.782 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:19.507+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:19.782 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:19.507+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:19.782 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:19.507+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:20.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:19.784+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:20.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:19.784+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:20.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:19.784+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:20.210 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:19.784+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:52.969161+0000 front 2024-09-17T01:17:52.969076+0000 (oldest deadline 2024-09-17T01:18:18.269092+0000) 2024-09-17T01:18:20.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:20.748+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:28.565413+0000 front 2024-09-17T01:17:28.565561+0000 (oldest deadline 2024-09-17T01:17:53.265415+0000) 2024-09-17T01:18:20.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:20.748+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:33.265927+0000 front 2024-09-17T01:17:33.266014+0000 (oldest deadline 2024-09-17T01:17:59.165833+0000) 2024-09-17T01:18:20.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:20.748+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:44.367364+0000 front 2024-09-17T01:17:44.367352+0000 (oldest deadline 2024-09-17T01:18:08.367691+0000) 2024-09-17T01:18:20.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6[129055]: 2024-09-17T01:18:20.748+0000 7efdcda82640 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:52.969161+0000 front 2024-09-17T01:17:52.969076+0000 (oldest deadline 2024-09-17T01:18:18.269092+0000) 2024-09-17T01:18:20.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:20.501+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:20.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:20.501+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:20.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:20.501+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:20.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:20 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:20.501+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:21.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:21 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:21.526+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:21.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:21 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:21.526+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:21.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:21 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:21.526+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:21.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:21 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:21.526+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:22.251 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:21 smithi135 podman[153625]: 2024-09-17 01:18:21.987826001 +0000 UTC m=+5.446786904 container died aed6d465c455efbd7e7471b9acccae2e326629891d525f49c34e28c35f236377 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T01:18:22.515 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:22 smithi135 podman[153625]: 2024-09-17 01:18:22.427551734 +0000 UTC m=+5.886512635 container cleanup aed6d465c455efbd7e7471b9acccae2e326629891d525f49c34e28c35f236377 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T01:18:22.516 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:22 smithi135 bash[153625]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6 2024-09-17T01:18:22.960 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:22 smithi135 podman[153654]: 2024-09-17 01:18:22.654004531 +0000 UTC m=+0.662654226 container remove aed6d465c455efbd7e7471b9acccae2e326629891d525f49c34e28c35f236377 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-17T01:18:22.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:22.517+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:22.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:22.517+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:22.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:22.517+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:22.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:22 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:22.517+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:23.387 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:23 smithi135 podman[153745]: 2024-09-17 01:18:22.993404528 +0000 UTC m=+0.016279691 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:18:23.388 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:23 smithi135 podman[153745]: 2024-09-17 01:18:23.096338938 +0000 UTC m=+0.119214098 container create 76040bf47e3e05533312aa43f71d977302b24a5ed0e785cd95414279466de637 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:18:23.388 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:23 smithi135 podman[153745]: 2024-09-17 01:18:23.307160973 +0000 UTC m=+0.330036137 container init 76040bf47e3e05533312aa43f71d977302b24a5ed0e785cd95414279466de637 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:18:23.388 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:23 smithi135 podman[153745]: 2024-09-17 01:18:23.310420317 +0000 UTC m=+0.333295477 container start 76040bf47e3e05533312aa43f71d977302b24a5ed0e785cd95414279466de637 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T01:18:23.388 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:23 smithi135 podman[153745]: 2024-09-17 01:18:23.390323879 +0000 UTC m=+0.413199046 container attach 76040bf47e3e05533312aa43f71d977302b24a5ed0e785cd95414279466de637 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T01:18:23.710 INFO:journalctl@ceph.osd.6.smithi135.stdout:Sep 17 01:18:23 smithi135 podman[153745]: 2024-09-17 01:18:23.497856817 +0000 UTC m=+0.520731985 container died 76040bf47e3e05533312aa43f71d977302b24a5ed0e785cd95414279466de637 (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:18:23.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:23.545+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:23.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:23.545+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:23.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:23.545+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:23.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:23 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:23.545+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:24.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.6.service' 2024-09-17T01:18:24.166 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:18:24.166 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-17T01:18:24.166 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-17T01:18:24.166 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.7 2024-09-17T01:18:24.460 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 systemd[1]: Stopping Ceph osd.7 for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:18:24.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:24.512+0000 7f1401aae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:18:24.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:24.512+0000 7f1401aae640 -1 osd.7 187 *** Got signal Terminated *** 2024-09-17T01:18:24.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:24.512+0000 7f1401aae640 -1 osd.7 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:18:24.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:24.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:24.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:24.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:24.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:24.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:24.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:24 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:24.518+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:25.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:25.524+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:25.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:25.524+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:25.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:25.524+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:25.961 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:25 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:25.524+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:26.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:26.558+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:26.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:26.558+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:26.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:26.558+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:26.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:26 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:26.558+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:27.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:27.512+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:27.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:27.512+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:27.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:27.512+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:27.710 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:27 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:27.512+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:28.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:28.554+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6804 osd.0 since back 2024-09-17T01:17:27.063066+0000 front 2024-09-17T01:17:27.063197+0000 (oldest deadline 2024-09-17T01:17:50.563256+0000) 2024-09-17T01:18:28.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:28.554+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6812 osd.1 since back 2024-09-17T01:17:35.264038+0000 front 2024-09-17T01:17:35.264027+0000 (oldest deadline 2024-09-17T01:17:58.664252+0000) 2024-09-17T01:18:28.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:28.554+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6820 osd.2 since back 2024-09-17T01:17:40.865737+0000 front 2024-09-17T01:17:40.865770+0000 (oldest deadline 2024-09-17T01:18:06.765531+0000) 2024-09-17T01:18:28.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:28.554+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.71:6828 osd.3 since back 2024-09-17T01:17:49.467007+0000 front 2024-09-17T01:17:49.466973+0000 (oldest deadline 2024-09-17T01:18:14.766957+0000) 2024-09-17T01:18:28.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:28 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7[139546]: 2024-09-17T01:18:28.554+0000 7f13fa0bc640 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.135:6804 osd.4 since back 2024-09-17T01:18:01.768351+0000 front 2024-09-17T01:18:01.768233+0000 (oldest deadline 2024-09-17T01:18:28.168448+0000) 2024-09-17T01:18:30.155 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:29 smithi135 podman[153849]: 2024-09-17 01:18:29.890296409 +0000 UTC m=+5.500253562 container died 3327a7bed00a31a5f0565bd8381150af5079306124bb6799e1747aa6f47c60fa (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T01:18:30.460 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:30 smithi135 podman[153849]: 2024-09-17 01:18:30.340835387 +0000 UTC m=+5.950792526 container cleanup 3327a7bed00a31a5f0565bd8381150af5079306124bb6799e1747aa6f47c60fa (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-17T01:18:30.460 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:30 smithi135 bash[153849]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7 2024-09-17T01:18:30.930 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:30 smithi135 podman[154307]: 2024-09-17 01:18:30.625341016 +0000 UTC m=+0.730379669 container remove 3327a7bed00a31a5f0565bd8381150af5079306124bb6799e1747aa6f47c60fa (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T01:18:32.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:32 smithi135 podman[154630]: 2024-09-17 01:18:32.701578184 +0000 UTC m=+0.016340494 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:18:32.960 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:32 smithi135 podman[154630]: 2024-09-17 01:18:32.801259996 +0000 UTC m=+0.116022297 container create 4254f3deff7762b106919016f6c8f2200dc862a69c670af0755a99474ed0aabb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:18:33.286 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:33 smithi135 podman[154630]: 2024-09-17 01:18:33.205284351 +0000 UTC m=+0.520046658 container init 4254f3deff7762b106919016f6c8f2200dc862a69c670af0755a99474ed0aabb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T01:18:33.286 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:33 smithi135 podman[154630]: 2024-09-17 01:18:33.20858457 +0000 UTC m=+0.523346873 container start 4254f3deff7762b106919016f6c8f2200dc862a69c670af0755a99474ed0aabb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T01:18:33.286 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:33 smithi135 podman[154630]: 2024-09-17 01:18:33.288712325 +0000 UTC m=+0.603474628 container attach 4254f3deff7762b106919016f6c8f2200dc862a69c670af0755a99474ed0aabb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-17T01:18:33.916 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 17 01:18:33 smithi135 podman[154630]: 2024-09-17 01:18:33.632554407 +0000 UTC m=+0.947316783 container died 4254f3deff7762b106919016f6c8f2200dc862a69c670af0755a99474ed0aabb (image=quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:18:34.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@osd.7.service' 2024-09-17T01:18:34.974 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:18:34.974 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-17T01:18:34.974 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-17T01:18:34.975 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a 2024-09-17T01:18:35.186 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 systemd[1]: Stopping Ceph prometheus.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:18:35.851 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T01:18:35.851 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-17T01:18:35.851 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.586Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.587Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.587Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a[61515]: ts=2024-09-17T01:18:35.587Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-17T01:18:35.852 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:35 smithi135 podman[154797]: 2024-09-17 01:18:35.596843195 +0000 UTC m=+0.152544980 container died 9b787f60f5f1bfa76f432ca497d8ea4c508dd5beaf1f6c721f4d72c3f8eaaf1d (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:36.210 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:36 smithi135 podman[154797]: 2024-09-17 01:18:36.069483207 +0000 UTC m=+0.625184990 container cleanup 9b787f60f5f1bfa76f432ca497d8ea4c508dd5beaf1f6c721f4d72c3f8eaaf1d (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:36.210 INFO:journalctl@ceph.prometheus.a.smithi135.stdout:Sep 17 01:18:36 smithi135 bash[154797]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T01:18:37.019 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e9235fcc-748e-11ef-bceb-c7b262605968@prometheus.a.service' 2024-09-17T01:18:37.058 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:18:37.058 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-17T01:18:37.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9235fcc-748e-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:18:39.646 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:39 smithi071 systemd[1]: Stopping Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:18:39.974 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:39 smithi071 podman[182458]: 2024-09-17 01:18:39.663070565 +0000 UTC m=+0.116616030 container died ac488328042747748583b43cc3e6195a96f1d4f669bf8778dd87f65273c2a19d (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:39.974 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:39 smithi071 podman[182458]: 2024-09-17 01:18:39.977183282 +0000 UTC m=+0.430728756 container cleanup ac488328042747748583b43cc3e6195a96f1d4f669bf8778dd87f65273c2a19d (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:40.384 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:39 smithi071 bash[182458]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a 2024-09-17T01:18:40.384 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:40 smithi071 podman[182473]: 2024-09-17 01:18:40.161538956 +0000 UTC m=+0.501976814 container remove ac488328042747748583b43cc3e6195a96f1d4f669bf8778dd87f65273c2a19d (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:40.384 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:40 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:18:40.820 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:40 smithi071 systemd[1]: Stopping Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:18:40.820 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:40 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-17T01:18:40.820 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:40 smithi071 systemd[1]: Stopped Ceph node-exporter.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:18:40.821 INFO:journalctl@ceph.node-exporter.a.smithi071.stdout:Sep 17 01:18:40 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.a.service: Consumed 3.290s CPU time. 2024-09-17T01:18:41.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:40 smithi071 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a[62997]: ts=2024-09-17T01:18:40.822Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-17T01:18:41.146 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:40 smithi071 podman[182580]: 2024-09-17 01:18:40.864009035 +0000 UTC m=+0.133740667 container died f51d370b6cd50fce9bcde453f9c3fce7e88c42fceddc01d1560983fe42c00a83 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:41.504 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:41 smithi071 podman[182580]: 2024-09-17 01:18:41.240118368 +0000 UTC m=+0.509850004 container cleanup f51d370b6cd50fce9bcde453f9c3fce7e88c42fceddc01d1560983fe42c00a83 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:41.505 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:41 smithi071 bash[182580]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a 2024-09-17T01:18:41.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:41 smithi071 podman[182592]: 2024-09-17 01:18:41.507706217 +0000 UTC m=+0.636132936 container remove f51d370b6cd50fce9bcde453f9c3fce7e88c42fceddc01d1560983fe42c00a83 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T01:18:41.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:41 smithi071 podman[182592]: 2024-09-17 01:18:41.58318143 +0000 UTC m=+0.711608076 volume remove 7ae179ff1a671d78381ad2a86df19c38db90a916de72302f11d5406e69d46028 2024-09-17T01:18:41.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:41 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-17T01:18:41.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:41 smithi071 systemd[1]: Stopped Ceph alertmanager.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:18:41.896 INFO:journalctl@ceph.alertmanager.a.smithi071.stdout:Sep 17 01:18:41 smithi071 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@alertmanager.a.service: Consumed 1.859s CPU time. 2024-09-17T01:19:15.921 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9235fcc-748e-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:19:18.383 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:18 smithi135 systemd[1]: Stopping Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:19:18.655 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:18 smithi135 podman[156266]: 2024-09-17 01:19:18.38539552 +0000 UTC m=+0.113286411 container died 1e7677cc058d70350e10de855e808288170e7e7bf2ae9a243c117edcd8cbc932 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:19:19.210 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:18 smithi135 podman[156266]: 2024-09-17 01:19:18.957913459 +0000 UTC m=+0.685804338 container cleanup 1e7677cc058d70350e10de855e808288170e7e7bf2ae9a243c117edcd8cbc932 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:19:19.210 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:18 smithi135 bash[156266]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b 2024-09-17T01:19:19.574 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:19 smithi135 podman[156278]: 2024-09-17 01:19:19.217812312 +0000 UTC m=+0.836012359 container remove 1e7677cc058d70350e10de855e808288170e7e7bf2ae9a243c117edcd8cbc932 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T01:19:19.574 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:19 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-17T01:19:19.575 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:19 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-17T01:19:19.575 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:19 smithi135 systemd[1]: Stopped Ceph node-exporter.b for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:19:19.575 INFO:journalctl@ceph.node-exporter.b.smithi135.stdout:Sep 17 01:19:19 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@node-exporter.b.service: Consumed 3.226s CPU time. 2024-09-17T01:19:19.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:19 smithi135 systemd[1]: Stopping Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968... 2024-09-17T01:19:19.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:19 smithi135 ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a[55114]: t=2024-09-17T01:19:19+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-09-17T01:19:19.960 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:19 smithi135 podman[156361]: 2024-09-17 01:19:19.706249681 +0000 UTC m=+0.120746293 container died 76460c4e7b85aef319f42e8a86378536a76a8ffad60cf29814866312b0704e65 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-type=git, com.redhat.component=ubi8-container, io.k8s.display-name=Red Hat Universal Base Image 8, release=236.1648460182, build-date=2022-03-28T10:36:18.413762, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, io.openshift.tags=base rhel8, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, description=Ceph Grafana Container, version=8.5, name=ubi8, architecture=x86_64) 2024-09-17T01:19:20.210 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:20 smithi135 podman[156361]: 2024-09-17 01:19:20.137217644 +0000 UTC m=+0.551714261 container cleanup 76460c4e7b85aef319f42e8a86378536a76a8ffad60cf29814866312b0704e65 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, build-date=2022-03-28T10:36:18.413762, name=ubi8, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, com.redhat.component=ubi8-container, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, io.buildah.version=1.24.2, description=Ceph Grafana Container, io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, summary=Grafana Container configured for Ceph mgr/dashboard integration, maintainer=Paul Cuzner , vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=236.1648460182) 2024-09-17T01:19:20.210 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:20 smithi135 bash[156361]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a 2024-09-17T01:19:20.710 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:20 smithi135 podman[156374]: 2024-09-17 01:19:20.330085843 +0000 UTC m=+0.621360924 container remove 76460c4e7b85aef319f42e8a86378536a76a8ffad60cf29814866312b0704e65 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana-a, version=8.5, io.openshift.expose-services=, vcs-type=git, com.redhat.component=ubi8-container, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=ubi8, release=236.1648460182, vendor=Red Hat, Inc., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, build-date=2022-03-28T10:36:18.413762, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, maintainer=Paul Cuzner , description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182) 2024-09-17T01:19:20.710 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:20 smithi135 bash[156388]: Error: no container with name or ID "ceph-e9235fcc-748e-11ef-bceb-c7b262605968-grafana.a" found: no such container 2024-09-17T01:19:20.710 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:20 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@grafana.a.service: Deactivated successfully. 2024-09-17T01:19:20.711 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:20 smithi135 systemd[1]: Stopped Ceph grafana.a for e9235fcc-748e-11ef-bceb-c7b262605968. 2024-09-17T01:19:20.711 INFO:journalctl@ceph.grafana.a.smithi135.stdout:Sep 17 01:19:20 smithi135 systemd[1]: ceph-e9235fcc-748e-11ef-bceb-c7b262605968@grafana.a.service: Consumed 5.673s CPU time. 2024-09-17T01:19:43.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:19:43.585 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:19:43.613 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T01:19:43.615 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978/remote/smithi071/crash 2024-09-17T01:19:43.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:19:43.699 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:19:43.699 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:19:43.702 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978/remote/smithi135/crash 2024-09-17T01:19:43.703 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:19:43.742 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:19:43.742 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:19:43.743 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T01:19:43.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v CEPHADM_STRAY_DAEMON | egrep -v CEPHADM_FAILED_DAEMON | egrep -v CEPHADM_AGENT_DOWN | head -n 1 2024-09-17T01:19:43.783 INFO:tasks.cephadm:Compressing logs... 2024-09-17T01:19:43.783 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:19:43.826 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:19:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-17T01:19:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-09-17T01:19:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/tcmu-runner.log 2024-09-17T01:19:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-17T01:19:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-17T01:19:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:: No such file or directory 2024-09-17T01:19:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:19:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-17T01:19:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:19:43.855 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr: 87.8% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/tcmu-runner.log.gz 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.foo.smithi071.hdtkfj.log 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.foo.smithi071.hdtkfj.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr: 76.0% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.foo.smithi071.hdtkfj.log.gz 2024-09-17T01:19:43.856 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.smpl.smithi071.dosgxu.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.smpl.smithi135.zqqxdl.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.foo.smithi135.zorred.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.smpl.smithi135.zqqxdl.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr: 77.0%/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.foo.smithi135.zorred.log: -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.smpl.smithi135.zqqxdl.log.gz 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr: 75.6% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.foo.smithi135.zorred.log.gz 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.log: 91.2% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-17T01:19:43.860 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mgr.x.log: 88.1% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:19:43.861 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:19:43.861 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.2.log: 94.9% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:19:43.861 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-17T01:19:43.862 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.smpl.smithi071.dosgxu.log: 76.3% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-client.rgw.smpl.smithi071.dosgxu.log.gz 2024-09-17T01:19:43.862 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:19:43.871 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-17T01:19:43.875 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.b.log: 92.9%/var/log/ceph/cephadm.log: -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:19:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:19:43.884 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3%/var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:19:43.893 INFO:teuthology.orchestra.run.smithi071.stderr: 95.5% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:19:43.907 INFO:teuthology.orchestra.run.smithi135.stderr: 92.2% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:19:43.912 INFO:teuthology.orchestra.run.smithi135.stderr: 89.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:19:43.913 INFO:teuthology.orchestra.run.smithi071.stderr: 91.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:19:43.919 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:19:44.114 INFO:teuthology.orchestra.run.smithi071.stderr: 87.7% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-17T01:19:44.710 INFO:teuthology.orchestra.run.smithi071.stderr: 92.6% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-17T01:19:44.737 INFO:teuthology.orchestra.run.smithi135.stderr: 92.5% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-17T01:19:45.016 INFO:teuthology.orchestra.run.smithi135.stderr: 92.8% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-17T01:19:45.206 INFO:teuthology.orchestra.run.smithi135.stderr: 93.6% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-17T01:19:45.546 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-17T01:19:45.846 INFO:teuthology.orchestra.run.smithi135.stderr: 93.7% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-17T01:19:45.869 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-17T01:19:45.891 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-17T01:19:46.018 INFO:teuthology.orchestra.run.smithi071.stderr: 91.8% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-17T01:19:46.044 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-17T01:19:46.137 INFO:teuthology.orchestra.run.smithi135.stderr: 93.9% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-17T01:19:46.140 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-17T01:19:46.140 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m2.299s 2024-09-17T01:19:46.140 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m9.479s 2024-09-17T01:19:46.140 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m0.367s 2024-09-17T01:19:46.466 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/e9235fcc-748e-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-17T01:19:46.468 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-17T01:19:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m2.629s 2024-09-17T01:19:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m11.374s 2024-09-17T01:19:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.431s 2024-09-17T01:19:46.469 INFO:tasks.cephadm:Archiving logs... 2024-09-17T01:19:46.469 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978/remote/smithi071/log 2024-09-17T01:19:46.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:19:47.917 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978/remote/smithi135/log 2024-09-17T01:19:47.918 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:19:49.158 INFO:tasks.cephadm:Removing cluster... 2024-09-17T01:19:49.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9235fcc-748e-11ef-bceb-c7b262605968 --force 2024-09-17T01:19:49.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e9235fcc-748e-11ef-bceb-c7b262605968 --force 2024-09-17T01:19:49.720 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T01:19:49.720 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T01:19:49.735 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T01:19:49.750 INFO:tasks.cephadm:Teardown complete 2024-09-17T01:19:49.751 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T01:19:49.760 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T01:19:49.761 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:19:49.777 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:19:49.789 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:19:49.794 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:19:49.794 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-17T01:19:49.794 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +3113us[+3100us] +/- 41ms 2024-09-17T01:19:49.794 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -4102us[-4115us] +/- 74ms 2024-09-17T01:19:49.794 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -2371us[-2385us] +/- 93ms 2024-09-17T01:19:49.794 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:19:49.805 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:19:49.809 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:19:49.809 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-17T01:19:49.809 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +3115us[+3150us] +/- 41ms 2024-09-17T01:19:49.810 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -4118us[-4084us] +/- 74ms 2024-09-17T01:19:49.810 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -2320us[-2320us] +/- 93ms 2024-09-17T01:19:49.810 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:19:49.810 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T01:19:49.818 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T01:19:49.819 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T01:19:49.851 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:19:49.960 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:19:50.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T01:19:50.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:19:50.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T01:19:50.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:19:50.125 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T01:19:50.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T01:19:50.201 INFO:teuthology.task.internal:Duration was 1960.761157 seconds 2024-09-17T01:19:50.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T01:19:50.251 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T01:19:50.251 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:19:50.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:19:50.290 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:19:50.292 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:19:50.750 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T01:19:50.750 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-17T01:19:50.750 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:19:50.770 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-17T01:19:50.770 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:19:50.818 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T01:19:50.818 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:19:50.820 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:19:50.891 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T01:19:50.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:19:50.893 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:19:51.704 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T01:19:51.713 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T01:19:51.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:19:51.738 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:19:51.763 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T01:19:51.773 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:19:51.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:19:51.801 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-17T01:19:51.827 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-17T01:19:51.855 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:19:51.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:19:51.878 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:19:51.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:19:51.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T01:19:51.921 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T01:19:51.922 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978/remote/smithi071 2024-09-17T01:19:51.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:19:51.980 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907978/remote/smithi135 2024-09-17T01:19:51.980 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:19:52.029 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T01:19:52.029 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:19:52.031 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:19:52.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T01:19:52.085 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T01:19:52.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T01:19:52.119 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T01:19:52.119 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:19:52.121 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:19:52.134 INFO:teuthology.orchestra.run.smithi071.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 01:19 /home/ubuntu/cephtest 2024-09-17T01:19:52.136 INFO:teuthology.orchestra.run.smithi135.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 01:19 /home/ubuntu/cephtest 2024-09-17T01:19:52.137 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T01:19:52.169 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T01:19:52.271 INFO:teuthology.run:Summary data: description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} duration: 1960.7611572742462 owner: scheduled_teuthology@teuthology success: true 2024-09-17T01:19:52.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:19:52.355 INFO:teuthology.run:pass